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“Twenty Years After,” (twenty 
years after the Publication of Ror- 
schach’s Psychodiagnostik), seems an 
appropriate time for retrospection 
and for contemplation of the future. 
In the spring of 1936 a group of four- 
teen Rorschach enthusiasts invested 
jointly the sum of $42.00 to create 
the mimeographed Rorschach  Re- 
search Exchange. This capital repre- 
sented the first year’s budget for the 
publication, After one year the circu- 
lation of the Exchange exceeded 100. 
Three years later the Exchange had 
developed into the Rorschach Insti- 
tute which, broadening its interests 
and functions evolved by 1947 into 
the Society for Projective Techniques. 

Simultaneously with the growth of 
organization and scope the Society 
hazarded the next evolutionary stage 
of changing its publication, renamed 
the Journal of Projective Techniques, 
from its tentative mimeographed 
form into its present printed one, in 
which ten volumes were printed. The 
circulation of Volume 20 exceeded 
for the first time 2000 copies, distrib- 
uted among members in most of the 
United States and twenty-one foreign 
countries and to subscribers in an 
additional twenty-one countries. 

The maturation of the Journal in 
its twenty years reflects both in for- 
mat and content the burgeoning of 
the field of clinical psychology and 
the increasing utilization of projec- 
tive methods in a variety of the so- 
cial sciences as well as in clinical psy- 
chology. It is evident that throughout 
these years a cross-fertilization of the 
several fields occurred and that frui- 
tion is not yet complete. The growth 
of the Journal we believe has been 
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not merely a quantitative expansion, 
but also an expression of significant 
maturation and differentiation of 
procedures, values, and knowledge. 

In this twenty-first year of publica- 
tion the Journal is stirring toward fur- 
ther expansion. A year ago we des- 
paired about publication lag and the 
receipt of each new manuscript was 
an occasion for concern, At present 
we have virtually no backlog and 
hence no publication lag beyond the 
period of time required for process- 
ing manuscripts. A manuscript can 
now be scheduled for publication in 
the next issue following its accept- 
ance. 

Several trends have converged to 
produce this most recent state of af- 
fairs. Our printer has increased the 
amount of material which can _ be 
printed on a page. Perhaps, too, we 
are breeding a new genus of clinicians 
who, knowing what they wish to say 
and having acquired a sound back- 
ground in scientific method, write 
precisely. Their papers have improved 
in quality to the point where the ac- 
ceptance rate seems now to be on the 
increase. The average length of pub- 
lished articles has shrunk from po 
thirteen pages to seven within four 
years. During the past ten years the 
Journal has tripled in the number 
of original papers, This means that 
we are using up manuscripts pretty 
rapidly, more rapidly in fact than we 
are accepting them. 

We are pleased that we are now 
able to extend an invitation to 
authors to submit their papers for 
almost immediate publication. 
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The Projective Question: Further Exploratory Studies' 


Henry P. Davin 
Department of Institutions and Agencies, State of New Jersey 


and 


WALTER W. LEACH 
Lafavette Clinic and Wayne Siate University 


Since the initial presentation of the 
Projective Question (+), we have fur- 
ther revised the method of admin- 
istration, refined scoring categories, 
and completed several exploratory 
studies which it seems appropriate to 
report at this time. Also presented are 
normative data, an illustrative proto- 
col, and a continued discussion of the 
Projective Question’s clinical impli- 
cations. 


INTRODUCTION 


It will be recalled from the earlier 
publication that the Projective Ques- 
tion is a brief, unstructured, verbal 
item, designed to quickly elicit depth 
psychological material. The subject is 
asked what he would most like to be 
(Positive PQ), and what he would 
least like to be (Negative PQ), if he 
were not a human being. The ques- 
tion is followed by an inquiry, so 
structured as to specify the general 
response and the reason or reasons 
for making a particular choice selec- 
tion. 

As previously noted, neither the 
term “Projective Question” nor the 
type of question asked were by any 
means original. Insofar as we have 
been able to determine, Levinson 
(10) first introduced the term in his 
report on eight questions asked in 
the studies on the authoritarian per- 
sonality. Van Krevelen’s (14) recent 
discussion of Pigem’s Wishing Test 
highlights the utility of a very similar 


' This study was completed while both auth- 
ors were on the staff of the Lafayette Clinic. 
Data on student nurses and medical students 
were obtained at the Western Psychiatric 
Institute, University of Pittsburgh School of 
Medicine. We wish to express our apprecia- 
tion to our cooperating colleagues, 


technique in the diagnostic appraisal 
of children. Still another Wishing 
Test (Wiinsch Probe) has been pub- 
lished by Wilde (15). 


In addition to the brief items al- 
ready cited (4), other related tech- 
niques have been reported. Gorham’s 
test of proverbs (6) seems practical 
for clinical exploration and estimat- 
ing intelligence. Baumgarten (1) of- 
fers proverbs for eliciting attitudes in 
specific areas. In diagnostic and thera- 
peutic interviews Benjamin's proverbs 
(2) have been found helpful. Zwer- 
ling’s technique of asking patients to 
tell their favorite joke (16) has been 
similarly useful. Perhaps even more 
depth-probing are Boernstein’s Verbal 
Self-Portrait Test (3) and The Earli- 
est Memory question developed by 
Saul, Snyder, and Sheppard (13). 
Lachman (8) has combined a series 
of twelve such brief items into the 
Self Explorations Inventory. 


REVISED PQ ADMINISTRATION 


As indicated in the postscript to the 
original communication (4), the PQ 
now consists of two related subques- 
tions, the Positive and Negative PQ; 
that is, “What would you most like 
to be if you were not a human be- 
ing?” and “What would you least 
like to be if you were not a human 
being?” In addition to probing into 
the reasons for a specific choice (ob- 
taining the theme), the inquiry has 
been extended to determine what spe- 
cific form of a more general species 
a subject may select. Although the 
questions are generally asked in the 
order here stated, some subjects may 
find it easier to reply first to one or 
the other. 








RESPONSE CLASSIFICATION 


Choice Categories: Continued ex- 
perience has shown that the initial 
list of eight categories is satisfactory 
for both Positive and Negative PQ. 
It may be desirable, however, to add 
a ninth by separating the previous 
combination of Solid Objects and 
Abstractions. Also, for the sake of se- 
mantics, the term Objects might be 
replaced by Concepts. 

Respondents’ choices still tend to 
cluster in four major categories; that 
is, Animals (Wild or Domestic); Bot- 
anical Concepts; Inanimate Concepts 
(Powered, Natural, Solid, and Ab- 
Sstractions); and Supernatural or 
Human Concepts. It has also become 
increasingly evident that categoriza- 
tion poses problems uniquely its own. 
There are vast differences within 
broadly conceived categories, as for 
example between rodents and lions, 
both of which are classified as wild 
animals. This is the old dilemma of 
having categories literal enough to 
permit highly reliable scoring and yet 
sufficiently interpretive to have clin- 
ical significance and theoretical im- 
plication. 

Theme Categories: The initial list 
of eight themes to describe positive 
PQ choices appeared to work out sat- 
isfactorily. (Independence, The Good 
Life, Beauty, Liked by People, Useful 
to People, Similar to People, Safety, 
and Special Attributes.) Themes for 
negative PQ choices were also de- 
veloped by content analysis. It was 
hardly surprising that they tended to 
be opposites: 

1. Dependence—meaning failure or 
inability to achieve independence; 
dependent on others for existence. 

2. The Hard Life—meaning life or 
the environment is difficult, frustrat- 
ing, unpleasant, too short. 

3. Unattractive Attributes — mean- 
ing emphasis on such characteristics 
as ugly, smelly, dirty, repulsive, 
sneaky, etc. 

4. Disliked by People or the Res- 
pondent—meaning that the choice is 
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feared, hated, disliked, held in con- 
tempt, etc. 

5. Harmful to People or Others— 
meaning that something is evil, dan- 
gerous, destructive. 

6. Dissimilar to People—the choice 
is disliked because it is so different or 
far removed from human attributes, 
e.g., no intelligence. 

7. No Safety — meaning that the 
choice object is in danger of losing 
his life, being killed or eaten, always 
pursued or threatened, etc. 

8. Special Attributes — Unusual 
properties peculiar to the choice ob- 
ject and not readily classifiable under 
any other theme category. 

Since many subjects frequently give 
more than one reason for selecting 
a particular choice, whether positive 
or negative, classifying responses for 
theme content is usually more diffi- 
cult than classification of the actual 
choice. For research purposes it is 
therefore important to train raters 
on how to determine and score the 
single most important attribute men- 
tioned, or on how a number of reas- 
ons cited reflect one particular theme. 
Once this has been accomplished, 
inter-rater reliabilities are satisfactor- 
ily high. 

The additional reasons expressed 
for selections may be considered in 
much the same light as additional 
scores on the Rorschach. However, 
this feature is probably best dealt 
with informally in making interpreta- 
tions rather than complicating the 
classification procedure. 


CONSISTENCY OF POSITIVE 
PQ RESPONSES 


To substantiate the normative 
data, we decided to follow up the ear- 
lier reported Positive PQ indications 
that “highly homogenous groups 
have very similar distributions of 
choice categories.” The percentage of 
subjects from a given population, se- 
lecting specific choice categories (e.g., 
Wild Animals, Domestic Animals, 
etc.) may be considered as the expec- 
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tancy that any one subject within the 
group will give that kind of response. 
To test this notion, the PQ was ad- 
ministered to groups similar to those 
on whom results were originally re- 
ported. A comparison of normative 
percentages would indicate the con- 
sistency of “most like to be” choice 
categories, 

In addition to the previously re- 
ported findings on 300 student nurses, 
150 medical students, 50 non-hospital- 
ized neuropsychiatric outpatients, and 
50 hospitalized neuropsychiatric in- 
patients, we classified the PQ res- 
ponses of 150 student nurses, 50 medi- 
cal students, 98 outpatients, and 44 
inpatients. For statistical purposes, 
Power, Natural, and Solid Concepts 
were combined into Inanimate Con- 
cepts. Similarly, Supernatural and 
Human Concepts were pooled. Wild 
Animals, Domestic Animals, and Bot- 
anical Concepts made up three other 
cells. The number of responses in 
each of these five choice categories, 
for the two groups constituting sep- 
arate samples from each of four popu- 
lations, served as the basis for com- 
puting chi square tests of significance. 


Although the figures cited in Table 
I are percentages, chi square tests 
were determined on the basis of raw 
scores. None of the probabilities were 
statistically significant. (To be sig- 
nificant at the .05 level of confidence 
with 4 d.f., they would have had to 
be about double the actual values 
obtained.) The results tend to con- 
firm the earlier notion that distri- 
butions of choice categories reflect 
an essentially stable variable among 
four distinct populations. It may 
well be that personality attributes 
suggested by a particular choice cate- 
gory, e.g., Independence—Wild Ani- 
mals, are also reliably reflected at 
the group level. 

Very similar findings were noted in 
a comparison of Positive PQ theme 
categories, and we are not therefore 
presenting a separate table. Themes 
predominant in one group of sub- 
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jects were equally predominant in a 
second group from the same popula- 
tion, whether student nurses, medical 
students, outpatients, or inpatients. 


NEGATIVE PQ EXPLORATORY STUDY 


It will be recalled that the original 
Exploratory Study reported only Posi- 
tive PQ data. The Negative PQ was 
individually administered to 40 hos- 
pitalized neuropsychiatric inpatients 
and 45 non-hospitalized neuropsychi- 
atric outpatients, matched for age, 
race, sex, marital status, education, 
and socio-economic background, The 
patients were similar to those origin- 
ally tested, being seen in a psychiatric 
training center affliated with a med- 
ical school. The Negative PQ was also 
group administered to 150 student 
nurses and 50 medical students, fur- 
ther samples from the same popula- 
tions tested earlier. 

The negative choices and theme 
categories are shown in percentage 
form in Tables II and III. It can be 
readily observed that the hospitalized 
patients deviate markedly, often re- 
fusing to give a reply, being unable 
or unwilling to shift away from 
human concepts, or failing to give 
reasons for choices made. While the 
Negative PQ tends to elicit predom- 
inantly wild animal responses, the 
popular choices of snakes, rodents, or 
insects are quite different from the 
birds and lions of the Positive PQ. 
It is rather likely that symbolized 
fears tend to be projected here. Do- 
mestic animals are cited only infre- 
quently by student nurses and medi- 
cal students; more so by outpatients 
and inpatients. Not wishing to be a 
dog or other domestic animal may 
represent some retreat from what is 
commonly accepted, or perhaps an 
inability to endure potential grati- 
fication of needs. It seems similar to 
rejecting a popular response on the 
Rorschach. The remaining choice 
categories do not reflect any marked 
differences, except that medical stu- 
dents seem more concerned with 
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Solid Concepts, indicating perhaps 
an effort to intellectualize. Outpa- 
tients, far more than others, like 
Supernatural Concepts, a possible 
symbol of neurotic anxieties and pre- 
occupations. 

Inspection of the percentage dis- 
tribution among the Negative PQ 
theme categories shows several inter- 
esting trends. Dependency is only 
rarely offered as a reason for a choice, 
but about twice as often by outpa- 
tients (7°) and inpatients (8%) 
than by medical students (4%) and 
student nurses (3°). More medical 
students (40%) reject the notion of 
a hard life than anything else, a 
theme cited by 19% of the nursing 
students and by less than 10% of 
either outpatients or inpatients. (No 
comment), Unattractive Attributes 
concern about 25°% of the nurses and 
20%, of the inpatients, tending to re- 
flect some preoccupation with how 
one is viewed by others. Another 
25% of the nurses seem to worry 
about being disliked, a thought men- 
tioned by 33% of the outpatients but 
by only 3% of the inpatients (who 
may have resolved the question). In- 
stead, 20%, of the inpatients talk of 
the dangers of being harmful, re- 
flecting perhaps the problems of how 
to deal with their inner aggression. 
While both medical students (15%) 
and student nurses (14°) are some- 
what concerned with safety, this is 
the second most frequently stated 
outpatient theme (24%), possibly 
showing their often acute anxieties 
and fears. It becomes readily appar- 
ent that themes are even more im- 
portant than choices in attempting 
to comprehend the dynamic impli- 
cations of a PQ response. 


AN INDIVIDUAL CASE PROTOCOL 


Since the explorative studies have 
been so concerned with classificatory 
and normative aspects, it may be de- 
sirable to present an individual PQ 
protocol. The respondent is a _26- 
year-old, married, female outpatient 
referred with a_psychophysiological 
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gastro-intestinal reaction. To facili- 
tate therapeutic planning, psycho- 
logical evaluation was requested and 
a complete battery of tests was ad- 
ministered. The Positive PQ follows: 


“Something that’s got a nice long life. . . 
Not an animal . . . they're dumb, not reason- 
ing beings. . . Plant life is short-lived, beauti- 
ful. . . I suppose something inanimate . . . 
Mt. Rushmore, . . . but that’s man-built. . . 
I imagine that’s going to endure for awhile. 

. Little by little it slips away each year. . . 
A stone would be all right too . . 
sions of grandeur. . . I 


. no delu- 
wouldn't want to 
change places with animal or plant life un- 
less I could be another person. . . In kidding 
discussion I've said I'd like to be a male but 
I think I’d like to be a female. . . There’s 
nothing great to being a male .. . being a 
male means responsibility, men don’t have 
much choice.” 


The Negative PQ: “Some form of plant life 
—specifically a flower, . . Their moment is so 
brief but there are some perennials. . . I 
wouldn't like to be a tree in a climate like 
Detroit. . . | wouldn’t want to be alone and 
unprotected. . . Some are majestic and grand 
to look at. . . In a real depressed mood, I 
think I'd pick on a weeping willow tree — 
dejected, casting-down-of-hands sort of look.” 


It is readily apparent that the pa- 
tient has given a great deal of pro- 
jective material with pointed clinical 
implications, e.g., her attitudes and 
feelings relative to survival, responsi- 
bility, sexual identification, depres- 
sion, physical display and _ attractive- 
ness, grandiosity, intellectual values, 
etc. The other projective data yield- 
ed more elaboration of these themes 
but little additional new material. 
Of course, we purposely selected an 
unusually rich PQ protocol, showing 
what might be elicited under ideal 
conditions. Briefer PQ responses 
have frequently been just as helpful 
in focusing on major conflicts and de- 
fenses. In that sense the PQ can stand 
on its own as well as contribute to 
the consistency and completeness of 
the skillful interpretation of a test 
battery. A number of psychiatrists 
now incorporate the PQ in their 
routine questioning. In our discus- 
sions of their findings, we try to em- 
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phasize that the seeming simplicity 
and brevity of the PQ does not neces- 
sarily restrict the clinician to a speci- 
fic symbolic interpretation or to nar- 
rowly applied notions of the patient’s 
expressed identification. 


DiscUSsION 


Perusal of current literature on 
projective techniques reflects some 
dissatisfaction with the relatively un- 
economic, time-consuming traditional 
procedures of evaluation. Kass (7) 
wonders “about the sheer economics 
of hours put into testing, recording, 
reviewing, pondering, interpreting 
results, and reporting conclusions. . . 
the worthwhileness of such heavy 
time investment if the most that can 
be said of a test’s contribution is that 
its results correlate significantly with 
findings from direct sources.” 

As the demands of clinical practice 
continue to expand, briefer tech- 
niques are likely to receive increas- 
ing attention. While not designed to 
replace more intensive — projective 
methods, they do offer important and 
at times dramatic insights to time- 
harassed clinicians. PQ material is 
seldom shallow or inconsequential. 
Although close to conscious cognitive 
and connative levels of ego function- 
ing, it often affords the patient an 
opportunity to express something he 
is unable to state directly. Where 
rapid clinical appraisals are needed, 
PQ responses may orient the direction 
of further inquiry. In this sense they 
are not very different from Rorschach 
content interpretation; yet, they pro- 
vide an opportunity for association 
to content without the necessity of 
considering perceptual elements. 

A criticism of note is one raised by 
Feifel (5) against most hypothetical 
situation techniques (a term pro- 
posed by Lehner (9) for brief ques- 
tions of the “If you had...” variety). 
Feifel commented that “the hypothet- 
ical situation technique reflects cul- 
tural and conventional stereotypes 
more than it does personal and idio- 


syncratic outlook.” This is certainly 
true in some instances; more fre- 
quently in group than in individual 
PQ administration. What is import- 
ant, however, is to establish, as Feifel 
suggests, group reference points or 
baselines from Which the clinician 
can assess individual responses and 
deviations, While some patients re- 
quire more “inquiry” than others, we 
have usually found important themes 
reflecting deeply personal meanings 
for what may have appeared at first 
a highly conventional choice. 

Another method of using PQ ma- 
terial may be to ask the patient to 
interpret his own responses. This 
technique, suggested by Luborsky 
(11) for the TAT, seems particularly 
appropriate in therapy. To the extent 
that individual meanings are related 
to a person’s coping and defensive 
responsiveness to life situations, the 
PQ ts a valuable clinical adjunct. 

While we do not have a great deal 
of evidence, there are some indica- 
tions that in normal subjects Positive 
PQ choices tend to reflect a more ra- 
tional intellectual reasoning process, 
whereas responses to the Negative 
PQ appear frequently less rational 
and more emotional in content, as if 
the subject were suddenly given an 
opportunity to vent a pent-up feeling. 
This might well be further explored. 
It also seems as if passive, introvert- 
ed subjects give more impersonal 
themes, such as “people like” or 
“people dislike” the given choice. 
Outgoing, assertive persons more 
readily identify themes as immedi- 
ately felt reasons for liking or dislik- 
ing a PQ response. 

Although we consider the PQ as 
primarily an individual projective 
technique, for some purposes it may 
be desirable to offer the subject al- 
ternative concepts in multiple choice 
fashion, e.g., dog, flower, snake; cat, 
storm, angel; car, mountain, monkey; 
amoeba, star, elephant, etc. Eventu- 
ally a scoring key might be devised 
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similar to those used with related 
questionnaires. 


SUMMARY 

The Projective Question is a brief, 
unstructured, verbal item, designed 
to apply the general principles of 
projective techniques to the study of 
personality. This paper is a continu- 
ation of an earlier one (4). It pre- 
sents more extensive methods of ad- 
ministration and_ classifying choice 
and theme categories. Also reported 
are further normative and explora- 
tory studies, an illustrative PQ proto- 


col, and a continued discussion of im-~ 


plications for clinical evaluation and 
personality dynamics. 
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A Rorschach Interview Technique: 


Clinical Validation of the Examiner’s Hypotheses ' 


Howarp M. HALPERN 
Bronx VA Hospital ‘ 


As the interest in content analysis 
of the Rorschach has grown, there 
have been many efforts to arrive at 
consistent theoretical or empirical 
frameworks for the interpretation of 
content (1, 3, 4). Correspondingly, 
there have been efforts to “validate” 
content by asking the subjects to give 
more ideational data in relation to 
his percept. For example, subjects 
might be asked to free associate to 
their own response (2) or to take a 
word association test? in which their 
percepts are included. More simply, 
subjects are commonly asked, “What 
does a ——— mean to you?” These are 
useful techniques but they have one 
common failing. They do not really 
validate the examiner's interpreta- 
tions. They serve only to give more 
associational material, and material 
that is largely on the same_ psychic 
level as the original response. The 
method proposed here does not aim 
at further associational data nor does 
it aim at validation of the content 
per se. It aims, instead, at testing the 
examiner's hypotheses about the 
meaning of the responses, 

THE INTERVIEW TECHNIQUE 

After the Rorschach is given in the 
standard manner—both performance 
proper and inquiry — an interval is 
needed before the patient is seen for 
a second session. During this interval 
the examiner carefully reviews the re- 


1 This is a technique developed by the author 
at the Bronx VA Hospital, largely in his 
work with locked ward psychiatric patients. 
It has also been used with open ward pa- 
tients and with neurological patients. Thanks 
are due to Leone N. Lesser, of the Bronx 
VA Hospital for her help in developing this 
procedure and to Dr, Zygmunt Piotrowski 
for his approval and encouragement. 
* Unpublished method by Jack Wanger of the 
Bronx VA Hospital. 


sponses and creates hypotheses about 
the dynamic well-springs of each per- 
cept. These hypotheses are then con- 
verted into questions that may be 
asked, quite directly, of the patient. 


The Construction of Questions 


In constructing questions the ex- 
aminer must approach each percept 
with the totality of his personal and 
professional experience and know- 
ledge. It has been found helpful for 
the examiner to “put himself into 
the percept,” at times actually assum- 
ing a position described in a response 
so that he may feel all the kinesthetic 
and proprioceptive cues that may 
have prompted the percept. His un- 
conscious processes may be given full 
reign because his hunches will be 
checked before they enter a consulta- 
tion report. 

Soise responses prompt many ques- 
tions. Here it has been found advis- 
able to limit oneself to two or three 
because similar questions will arise 
from other percepts. Questions may 
be on many levels — feelings, fanta- 
sies, impulses, history, or usual pat- 
terns of behavior. Above all, the ques- 
tion decided on should be the exam- 
iner’s reaction to the percept as given 
by that particular patient. 

At times questions may be con- 
structed not on the basis of content, 
but other reactions of the patient to 
the card such as unusual reaction 
times, card turning, facial expres- 
sions, remarks and manner of descrip- 
tion. When a _ patient’s initial re- 
action to the last three cards was 
color naming he was asked, “Do your 
emotions sometimes get the best of 
you?” and he replied, “Yea, they 
override my reasoning power and 
push me very hard. Normally I use 
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reasoning but after awhile I don't 
give a damn any more. I smash 
things apart, etc.” Another patient 
could not decide which way the 
woman he saw in the center of Card 
I was facing. He was asked, “Do 
women sometimes confuse you?” and 
he replied, “Uh-huh, all the time. 
Gee whizz! I can’t figure them out— 
what they want or expect. I can’t tell 
if they're lying or telling the truth, 
= 

The final consideration in ques- 
tion construction is its wording in 
the most easily acceptable form. This 
does not mean that an issue raised 
by a percept should be ducked if it 
taps potentially upsetting areas. It 
means only that the issue should not 
be approached too bluntly or harsh- 
ly. For example, a patient gave a re- 
sponse indicating grandiose ideas. 
The question asked was, “Do you 
have secret thoughts of wanting to be 
in the spotlight?” He replied, “No. 
Well, yes. I used to think of myself 
ne the Messiah. I'd 
bring salvation to the world.” A more 
frontal questioning of his grandiosity 
may have brought denial. 

It is usually best to make the first 
and last questions as non-anxiety 
arousing as possible. 


Instructions to the Patient 


When the patient is seen for a sec- 
ond session the questions are pre- 
sented to him in a highly structured 
manner. The interview is introduced 
approximately like this: “I am going 
to be asking you some questions of a 
rather personal nature, It is very im- 
portant that you cooperate by answer- 
ing them as frankly and as honestly as 
you can, At times, I may cut your re- 
sponse short. This is because I know 
there will be another question about 
it later. Are you ready?” Cooperation 
is usually excellent. 


CASE ILLUSTRATIONS 


To demonstrate this method, the 
protocols of two cases are given. Only 


the first five cards are presented here 
as that is felt to be sufficient to illus- 
trate the technique. The cases are 
both psychiatric patients. They are 
selected because they differ in educa- 
tion, intelligence, color, occupation 
and psychiatric diagnosis. 


Case A 


45 year old white married male 
with a provisional diagnosis of char- 
acter disorder with drug addiction. 
Prep school graduate. Editor of a 
small weekly newspaper. Full Scale 
1Q 121. 

I. 1. 13” An odd sort of jack-o-lantern 
Q. Do you feel you fool people and 

give them the wrong impression of 
yourself? 

A. Occasionally, I do— sometimes I 
give them the impression I'm a 
good deal smarter than I am. I'm 
glib—even here fellows think I 
know something on a good num- 
ber of subjects, I really don’t know 
that much, (?) It does make me 
feel phoney, deceptive. As a matter 
of fact, it gives me feelings of guilt. 

Q. Do you feel empty? 

A. Quite frequently I feel empty. I 
wonder how I held jobs of consid- 
erable responsibility without the 
background. Like I was a_profes- 
sional musician, who did pretty 
well, without formal training. 

2. 2 youngsters in a dancing position, 
Q. Did you have an active childhood? 
A. Fairly active —I played ball and 

liked to box and played some foot- 
ball, But I was never husky enough 
or aggressive enough. 

3. A caricature of 2 small birds wait- 
ing—or perhaps already being fed by 
the mother bird. 

Q. What type of woman was you 
mother? 

A. That’s hard to describe. She al- 
ways insisted we would be well 
trained. She wanted us to be per- 
forming animals before any guests 
that came, She was not cruel but 
unknowingly she could be cruel to 
her children. In this she was as 
innocent of cruelty as anyone 
could be. She had tremendous vi- 
tality and determination. 

Q. Did she give love and affection 








ad 


casily? 

A. That’s hard. I'm sure she loved 
her children and yet was restrained 
in a sense that I can’t quite de- 
scribe. For example, my being here 
—she seems very sympathetic on 
the phone and yet I feel she does 
it out of fear that I'll never snap 
out of this and she’s trying to en- 
courage me. She's afraid that at 
my age I'll never get back on my 
feet. I hope I haven’t given you 
the wrong impression about her. 


II. (He was about to say something, then 
turned the card.) 1. 23” A man crouched, 
as though looking over a cliff. 


Q. Are you concerned about the fut- 
ure? How? 

A. I’m concerned but inwardly I have 
the feeling that I'll succeed and 
overcome the problem by some 
means, in some way. I worry most 
about pressing things like bills and 
other finances, But I’m sure I'll 
land a job, etc. 

Q. Have you ever thought of suicide? 

A. I don't think I’ve thought of sui- 
cide more than the average person 
does. I stopped drinking because I 
had a fierce desire to live and 
make my life prevail. 

As though I were looking down from 

a plane, and saw part of a bomb 

bursting. 

Q. Do you have a temper? How do 
you control it? 

A. If I do have a temper I never 
manifest it outwardly. I can be 
very angry at a person and not 
show it to them. Later on, I seem 
to absorb it all myself. As though 
my whole being absorbs the anger 
like a sponge. I turn all the anger 
against myself. 


Two clowns. They seem to be coming 


together, as though in a mock fight. 

And they have simultaneously struck 

their knees together, 

Q. How did your parents get along? 

A. Wonderfully well. Of all people I 
know, I never knew two people as 
devoted as they were and are. You 
are aware instantly that they love 
each other very much. All my life 
I’ve known that, 

Q. Do you have any siblings? 

A. An older and a younger brother. 
Initially there were 2 sisters but 
they died. My oldest sister’s death 
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Was a great tragedy. We were all 
very fond of her. She was wonder- 
ful, brilliant. 

How did you get along with your 

brothers? 

A. With my older brother I didn’t 
get along as well as with the 
others, When he was young he had 
polio. A good deal of money was 
spent on him. When he began to 
recover, he lived as a_ privileged 
character and took a great deal of 
advantage of it. There were some 
open conflicts but never a serious 
breach. He would play my younger 
brother against me and vice versa. 
He is a little bit of a bully but 
most of it is all forgotten. 


~ 
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A caricature of a french poodle wear- 

ing a red cap. 

Q. Did your parents show you off and 
expect you to achieve a lot? 

A. Yes to both. She wanted us well 
trained and drilled. That's why 
she sent us to military school. 

5” —2 neighbors disputing — perhaps 

over who owns the lawn mower 01 

some garden implement. 

Q. What were the main conflicts in 
your family? 

A. There were never open and obvi- 
ous conflicts. If there were any, 
they were subtle. We all seemed 
to live in harmony. There were 
subtle undercurrents—it might be 
most between my mother and me. 
I could never clearly evaluate the 
relationship between us. At times 
I hated her, at other times there 
was a great deal of tenderness and 
pity for her. She could do things 
that were extremely exasperating. 
She had little mannerisms that | 
think she even knew exasperated 
me. She was a social snob, pre- 
judiced, narrow in her views of 
other people. 

Now I see 2 colored children — they 

appear to be in a dance, back to 

back. Their hands are raised and 
there is some colored balloon or toy 
that they tossed in the air. 

Q. Are you concerned about any sex 
problems? Do you feel guilty about 
any childhood experiences? 

A. No. When I was younger—I prob- 
ably was no different than any 
young fellow without experience— 
I might have been troubled by it 
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and had a feeling of guilt about 
the fact that I masturbated. I 
never really had a satisfactory sex 
life until I was married at 38, My 
wife and I are very compatible in 
that way and in almost all ways. 


8”— A Chinese dragon —it might be 
used in a float like on the Chinese 
tth of July or whatever they cele- 
brate. 


Q. What was your father like? Was 
he a distant man? 

A. I've always been very fond of him 
—he had a wonderful disposition. 
He would get up early and sing 
while shaving. As a child I re- 
member him as extremely well 
dressed. He generated a feeling of 
well being and a great sense of 
security. He has always been very 
good to me and tried to be un- 
derstanding. He’s a very good pro- 
vider and has a wonderful sense of 
humor. 

The vagina of a woman — where the 

vaginal opening is I should say. (He 

looked tense, reddened slightly.) 

Q. Do you have any present sexual 
concerns? 

A. I think I’ve already answered that. 


Some kind of a bird with enormous 

wing spread, although the wings are 

pulled together like it’s about to make 

a heavy stroke in the air, to be pro- 

pelled forward. A giant bat. 

Q. Are you ambitious? 

A. Secretly I probably have a good 
deal of ambition and anticipate a 
good deal more than I will prob- 
ably ever get out of life. 

Q. Do you put a lot of energy into 
success? 

A. Yes, in all the jobs I had I drive 
myself too hard, That’s probably 
why I’m not more of a success than 
I could have been, I get bogged 
down in detail instead of being a 
good administrator—delegate work 
and maintain cooperation. 

. Do you like to win over others? 

. Yes. That’s a trick question. I 
want to win and yet when I do, 
I probably appear like a damn 
fool trying to put on a phoney act 
of complete modesty. Yet I want 
the feeling of having won out. To 
me success is being able to do one 
or many things better than any- 
one else could do it. I wasn’t the 


>O 


4. 


13 


best in music so I couldn’t have a 
feeling of great fulfillment. 

A shoreline reflection of a tree that’s 

been doubled over by the wind. It’s 

sort of a quiet cove. It looks like it 
has never been inhabited by any man. 

Q. Do you ever hope to get away 
from it all and be yourself? 

A. I've entertained quite often the 
wish that my wife, little girl and 
I could go live in a very quiet 
community, a small town, where I 
could own and run my own news- 
paper and be known and liked by 
everybody. I wouldn’t be subject 
to the pressures of my work in a 
metropolitan area. 

Q. Are you troubled by feelings of 
loneliness? 

A. Not since I’ve been married. Until 
then I was extremely lonely and 
thought I would be all my life. I 
suppose I’m no different from any 
other person in the feeling there 
is some secret island in myself that 
no one could reach or inhabit. I 
had that feeling even after I was 
married —a secret inviolable part 
that even my wife could never 
know. But it’s gone away, gradu- 
ally diminished. My wife has got- 
ten to know me better than I un- 
derstand myself—and still she has- 
n’t lost her belief in me. 


12” Leoks like an animal’s antenna. 

Q. Are you sensitive to criticism and 
what others think? 

A. Yes—I’m concerned what other 
people think. That’s why I'm up- 
set about this exam, which is a 
simple thing and will be very re- 
vealing to those who study the re- 
sults and I’m anxious to have all 
people think well of me. I can 
take criticism well but I 
prefer it to be praise. 

A ram's head. 

Q. Do you often get into clashes with 
others? 

A. Rarely. Never an open clash. The 
only thing I had which you could 
call a clash was last year when I 
had some difficulty about someone 
at work, etc. Whenever I have a 
clash, the after effects are too 
devastating. It disturbs me — you 
make a fool of yourself and it 
means you haven’t been able to 
handle a situation well. 


would 








or 


A woman with her knees sort’ of 
knocked together. As though swing- 
ing either 2 partners on either side 
of her—or she has heavy veils of some 
kind, 


Q. Was your mother controlling? 
Domineering? Manipulating? 

A. Yes, (Long pause.) She's very de- 
ceiving. If you meet her for the 
first time she seems like a gentle, 
sweet, delicate old lady. But even 
today she has an indominatable 
spirit. She epitomizes being subtly 
domineering. The iron fist in the 
velvet glove, 

Q. Do you feel that you can do some 
difficult things very well? 

A. I can’t think of any off hand. No. 
But then few people could do the 
work alone that I have done for 
many years. 


The top portion of a skull. Only the 

top—nothing else (used white space). 

Q. Do you rely a lot on thinking 
things out rationally in order to 
control your impulses? 

A. In some wavs, yes. In others, if 
I had done rational thinking I 
wouldn’t be here. I try to approach 
a good many problems at work — 
where important decisions must 
be made—by logic. But anything 
closely connected to my personal 
self, IT haven't been rational. When 
a psychiatrist’ prescribed drugs I 
should have know that since I had 
once been an alcoholic I could 
never use anything as a crutch. 


A discarded toupee (laughed). 
Q. Are you concerned about getting 


older? Losing abilities? Losing vir- 
ility? 
A. Yes—any fellow my age would. 
Particularly in the position I’m in 
— there is an age limit to hiring 
people. I feel I still have the abili- 
ties. As far as sex goes, there is a 
good deal of difference between 20 
and 45 but no, I’m not as vet 
concerned. 
A dog, either sitting up begging or 
learning a trick. 
Q. What was the best way to get 
your mother’s attention? 
(Laughed.) Some question! (Long 
pause.) I can’t recall. You mean at 
5 or 6? I usually went directly to 
her and asked for something if I 
wanted something. It would most 
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please her when I was obedient 
and did what she wanted and dis- 
plaved good manners. I can’t re- 
call that I ever cried or had a 
tantrum, That just wouldn't work 
with her. 


Case B 


28 year old Negro married male 
with a provisional psychiatric diag- 
nosis of anxiety reaction. Ilth grade 
education in South Carolina, Labor- 
er. Full Scale 1.Q. 93. 

I. 1.1" A bat. He got his back toward 
me. Just standing with his wings 
spread. The bottom of his wings 
could be torn parts of the bat. 

Q. Do you sometimes wish you were 
more active? 

A. I sometimes wish I was more bold 
and frank. I wish I could come 
out and tell a person what I think 
of them. And be quick to meet 
people. IT am = shy, with women 
especially. 

2. Looks like a map, too. The wings 
look like maps and islands. 

Q. Do vou often hide your real feel- 
ings from people? 

A. Yeah. (?) With men, I don't hide 
nothing. But with women, the fe- 
male sex, I hide my feeling entire- 
lv. Sometimes they do things to 
me IT don’t like —TI usually don't 
say anything about it, Q. Like 
with my wife, she does things 
wrong and I don’t say anything 
about it until I blow up. 

Looks like a bug. (7) A beetle bug, 

getting ready to get something to eat 

— mouth open and claws open. 

Q. Was your mother a person who 
tried hard to control you? 

A. She had no trouble with me on 
that. (?) I was always glad to do 
something for my mother. But my 
father —he held the upper hand 
there. He made you do things for 
him. But my mother never had a 
lot to say — she worked hard. 

4. Some islands. 

Q. Do you ever feel very lonely? 

A. Uh-huh. T just feel like I want to 
talk to somebody—somebody I like 
real good and love real good. It’s 
been my biggest problem for years. 
Like now, I’m separated from my 
wife —I want to see her but she 
recommended I leave and I’m too 
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bull-headed to write her. So it 
leaves an empty space. 

20” Oh, looks like 2 chinchillas. (?) 
Their feet are tied together —I won- 
der why they're tied together? Just 
like me in my mind. I am tied to- 
gether with something but I don’t 
want to face it. Subconscious-like. 
Like there is something I just got to 
do. There's always a load, something 
heavy, something I can’t do alone, | 
always set large goals but I never 
make it and I lose interest. These 
things are tied together, They're try- 
ing to get somewhere but one is hold- 
ing the other one back. I believe these 
chinchillas want to eat these feet or 
sox but they are tied together to keep 
them from getting it, one is trying to 
beat the other. 

Q. Do you ever feel very angry deep 
inside of you? How do you show 
it? 

A. Uh-huh. I feel like I want to tear 
up something. At home I would — 
then I'd feel OK, It is letting off 
steam. I'd tear off doors, windows— 
every week. But I was OK. It was 
worth it. 

Q. Do you ever get very depressed? 

A. Yeah, I feel like everybody’s down 
on me, that there is nobody giving 
me a hand. I don’t mean with my 
bills. When I need someone to 
lean on, to praise me, there is no 


one and I'll feel repressed and 
downhearted. 
Q. Did you have brothers and sis- 


ters? How did you get along? 

A. There were 9 in the family, I’m 
the third. We got along OK. Me 
and my older brother were rough. 
We used to like to fight. People 
were always picking on me, I 
fought a lot with my older brother, 
about different things —he’d get 
my things or put work off on me. 
(It must have been tough getting 
attention in such a big family?) 
I know — my parents didn’t have 
time for that. My father had time 
but he didn’t take the time. My 
mother just didn’t have the time. 


5” A butterfly, 
Looks like 2 stomachs. 


Q. Do you worry much about your 
health? 

A. Physically, I’m OK. I never get 
sick. 


15 


Weird looking things —I don’t know. 

Q. They're weird looking—with clawed 

feet. They look like something I’ve 

seen in a weird book. Something out 

of this world. And they’re holding 2 

kidneys over the front part of a 

skeleton. 

Q. Are you sometimes afraid of be- 
ing with people socially? 

A. Yeah, I just feel I’m not wanted. 
It feels like you're in the wrong 
world. 


30” 2 horns. Q, Ram's horns. 


Iwo feet, and 2 eyes and a head and 
2 ears — and tusks — and horns on the 
head. These things are impossible. 
People just can’t sit down and figure 
out these things. That's all I can see 
except monstrosities. (7) Some giant— 
a weird, hairy giant. I'll bet these are 
just: regular, everyday pictures. Not 
real inkblots. It would have to be a 
weird person to draw something like 
this. These things just don’t happen. 
Somebody in worse shape than I am 
had to make these. Only me and the 
man who made them can figure this 
out. 


Q. Do you feel people are often out 
to trick you? 
A. No—I never had that feeling. 


Q. Do you often feel you're different 
from most people? 
A. When I was a kid I used to feel 


that way and I guess a part of it 
still sticks with me. In school I'd 
study a lot, But my parents never 
told me I was as good as the next 
person because of the way I talked. 
And other people had _ better 
clothes than me. Today I stay in 
the middle bracket. They 
never said that the way I talked 
or did made any difference so I 
felt I was the underdog. 


class 


Q. Were you afraid of your father? 

A. Uh-huh. I can remember I was 
wearing diapers and wetting on 
myself when I was 3 years old. He 
took me and beat me until I 
couldn't ever holler. After that, 
whenever I saw him I'd start shak- 
ing, till I was 11 or 12 years old. 
There were always beatings, not 
spankings. It was with a leather 
strap. It seems like I was the only 
one who got the beatings like 
that. 





V. 1. 20” A bat — tails and ears. (7) Not 
flying — standing with wings spread. 


2. 2 legs and 2 tails — something like a 
lamb, or a lion, 

Q. Do you ever get confused about 
whether you should act angry or 
easy-going? 

A. Uh-huh. Like with my wiie I used 
to say, should I say something or 
let it go. Most of the time I’d let 
it go. The same with the kids and 
my mother-in-law. 

Q. Do you ever feel that if you are 
easy-going people will take advant- 
age of you? 

A. They do take advantage of me, I’ve 
been trying to stop being easy but 
I can’t. It’s just my nature. 


DISCUSSION 


This method, although prelimin- 
ary, seems to offer a simple, face value 
attempt at checking what the psy- 
chologist feels his subject is communi- 
cating. Some have objected that the 
questions asked are general questions 
het may be asked with profit of any 
patient. This criticism has validity 
— as Sullivan says, “people are more 
simply human than otherwise” so that 
hypotheses entertained about them 
have a large common base. But in a 
large number of Rorschach Inter- 
views, we find that questions do differ 
widely from patient to patient. In 
addition, there are two types of im- 
pressive evidence that the questions 
do hit at a deep and meaningful level 
of the patient’s psyche. First we note 
that the patient, unmindful of how 
the questions were created, will at 
times answer using a metaphor simi- 
lar to the percept. Note, e.g. in Case 
A, Card IV, response 4. The patient 
saw “ . . . sort of a quiet cove, It 
looks like it’s never been inhabited by 
any man.” When on the following 
day he was asked, “Are you troubled 
by feelings of loneliness?” he replied, 
“I suppose I’m no different from any 
other person in the feeling that there 
is a secret island in myself that no 
one would ever reach or inhabit.” 





A Rorschach Interview Technique 


In case B, Card III, response 3, the 

patient saw “weird looking things 
. Something out of this world.” 

The next day he was asked, “Are you 
sometimes afraid of being with people 
socially?” and he replied, “Yeah, I 
just feel I'm not wanted. It feels like 
you're in the wrong world.” There 
have been several such instances. 

The second indication that the 
questions are not general but highly 
personal lies in the reaction of most 
patients to the questions. After the 
interview is terminated there are 
frequently exclamations such as 
“Wow! Where did you get these 
questions?” “This is terrific — nobody 
ever asked me questions like that be- 
fore.” Often patients want to continue 
talking and it has been found neces- 
sary to sit with them for awhile to re- 
duce their stimulated state. There 
have been no poor after effects — in 
fact one psychiatrist reported that the 
interview opened up new areas for 
the patient in psychotherapy. 

Another advantage to the tech- 
nique is that it enables the psycholo- 
gist to better place the level of a re- 
sponse, At times, in a Rorschach 
filled with aggressive percepts, it is 
difficult to know if the aggression is 
on an impulse and ideation level or 
if it reaches explosive behavioral ex- 
pression. Asking such patients about 
his temper and how he handles it 
often gives a good picture of the re- 
lation of his feelings to his character- 
istic ways of dealing with them. 

Finally, it should be noted that the 
method described here may have 
value, not only clinically, but as a 
research tool in the meaning of pro- 
jected percepts and as a new way of 
learning content analysis. 


REFERENCES 


1. Holt, Robert R. Gauging primary and 
secondary processes in Rorschach responses. 
J. proj. Tech., 1956, 20, 14-25. 

2. Janis, M. G., and Janis, I. L. A supple- 
mentary test based on free associations to 
Rorschach responses. Rorschach Research Ex- 
change, 1946, 10, 1-19. 





Howarp M. HALPERN 17 
3. Phillips, L., and Smith, J. G. Rorschach 
interpretation: advanced technique. New 
York: Grune & Stratton, 1953. 
1. Schafer, Roy. Psychoanalytic interpreta- Received September 9, 1956 


tion in Rorschach testing: theory and appli- 
cation. New York: Grune & Stratton. 1954. 








The Adjustment of the Male Overt Homosexual 
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Current psychiatric and psycholog- 
ical opinion about the adjustment of 
the homosexual may be illustrated by 
a quotation from a report on homo- 
sexuality recently issued by the Group 
for the Advancement of Psychiatry (1, 
p. 2): “When such homosexual be- 
havior persists in an adult, it is then 
a symptom of a severe emotional dis- 
order.” If one wishes to subject this 
opinion to experimental investigation, 
one is immediately confronted by 
problems of considerable magnitude. 
One problem is the attitude and the- 
oretical position of the clinician who 
may be asked to examine the data. I 
quote again from the Group for the 
Advancement of Psychiatry in the 


1 This investigation was supported by a re- 
search grant, Grant M-839, from The Na- 
tional Institute of Mental Health of the 
National Institutes of Health, Public Health 
Service. 

* Paper read at the American Psychological 
Association Convention, Chicago, August 30, 
1956. 

‘T wish to acknowledge the invaluable as- 
sistance given by Dr. J. A. Gengerelli in act- 
ing as consultant on experimental design 
and statistical methodology. | wish also to 
gratefully acknowledge the contribution 
made to the project by Dr. Frederic G. Wor- 
den in his capacity of psychiatric consul- 
tant. Finally, there is no adequate way to 
express my gratitude to Dr. Karl Muenzinger 
for his assistance in thinking through the 
total project with me in its many phases. 


Editorial Note: It is an uncommon event in 
these days of compulsive publication to dis- 
cover an author who has worked diligently 
and with great detail and who hesitates to 
publish well-substantiated findings — until 
proof is virtually incontrovertible, A study 
such as Dr. Hooker's challenges several wide 
spread and emotional convictions. In view 
of the importance of her findings it seemed 
desirable to the editors that thev be made 
public, even in their preliminary form. If 
some of Dr. Hooker’s comments, as cautious- 
ly presented as thev are, seem premature or 
incompletely documented, the blame must 
fall on the editors who exercised consider- 
able pressure on her to publish now.—BRF 
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same report (1, p. 4): “It is well 
known that many people, including 
physicians, react in an exaggerated 
way to sexual deviations and particu- 
larly to homosexuality with disgust, 
anger, and hostility. Such feelings of- 
ten arise from the individual’s own con- 
flict centering about his unconscious 
homosexual impulses. These attitudes 
may interfere with an intelligent and 
objective handling of the problem.” 
One hopes that the clinician does not 
react with “disgust, anger, and _hos- 
tility.”” It is not realistic to hope that 
he will avoid theoretical preconcep- 
tions when looking at psychological 
material which he knows was_ ob- 
tained from a homosexual. 


From a survey of the literature it 
seemed highly probable that few clin- 
icians have ever had the opportunity 
to examine homosexual subjects who 
neither came for psychological help 
nor were found in mental hospitals, 
disciplinary barracks in the Armed 
Services, or in prison populations. It 
therefore seemed important, when | 
set out to investigate the adjustment 
of the homosexual, to obtain a sample 
of overt homosexuals who did not 
come from these sources; that is, who 
had a chance of being individuals 
who, on the surface at least, seemed 
to have an average adjustment, pro- 
vided that (for the purpose of the 
investigation) homosexuality is not 
considered to be a symptom of mal- 
adjustment. It also seemed important 
to obtain a comparable control group 
of heterosexuals, This group would 
not only provide a standard of com- 
parison but might also make it pos- 
sible to avoid labels and thus assist 
the clinician in suspending theoretical 
preconceptions. This, I recognized, 
would be fraught with extreme difh- 
culties, And so it was. Without re- 
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lating in detail the — in many ways — 
fascinating, frustrating, and gratify- 
ing aspects of the attempts to secure 
both of these groups, | shall describe 
the homosexual and _ heterosexual 
samples of thirty individuals each 
finally obtained. 

Each homosexual man is matched 
for age, education, and IQ with a 
heterosexual man. It would have been 
desirable to match for other variables, 
also, including occupation, but this 
was manifestly impossible. It should 
also be stated at the outset that no as- 
sumptions are made about the ran- 
dom selection of either group. No one 
knows what a random sample of the 
homosexual population would be 
like; and even if one knew, it would 
be extremely difficult, if not impos- 
sible, to obtain one. The _ project 
would not have been possible without 
the invaluable assistance of the Mat- 
tachine Society, an organization which 
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has as its stated purpose the develop- 
ment of a homosexual ethic in order 
to better integrate the homosexual 
into society. The members of the Mat- 
tachine Society not only made them- 
selves available as subjects but also 
persuaded their friends to become 
subjects, Because the heterosexuals 
were, for the most part, obtained from 
community organizations which must 
remain anonymous, I cannot describe 
further the way in which they were 
obtained. 

Considerable effort was devoted to 
securing the 30 matched pairs of sub- 
jects, and the data in Table I indi- 
cate that in most instances the match- 
ing was unusually close. 


The homosexuals, and thus the 
heterosexuals, ranged in age from 25 
to 50, with an average age of 34.5 for 
the homosexual group and 36.6 for 
the heterosexual group. The IQ range, 
as measured by the Otis Self-Adminis- 


TABLE I 
Homosexual Heterosexual 
Matched Pairs Age 1Q Education Age 1Q Education 

Number 

AA oe Ramat 12 105 12 il 105 12 
es 29 104 12 28 104 12 
3 29 109 9 31 109 12 
| s 31 120 16 30 123 16 
a) PRI ee Re Mem 44 127 18 15 126 17 
_ RR ee sebeilesbieaannitecstitsiedinh 33 127 16 32 129 16 
en Nat ere eshccncomwale 40 124 16 42 123 16 
8 eres ene olen eee eoree 33 124 16 36 122 16 
9 Real ee cele 10 98 12 12 100 12 
a i ee ene Ms 33 101 14 32 105 15 
11 en coe eee 30 127 14 29 127 16 
ae DON, elon ee PERSE 12 91 12 39 O41 14 
13 ssinipdiekanletuapabsdebeiaaotitakn 44 98 9 14 100 12 
RCE Re nereeer neta: ee 36 114 16 36 117 16 
ae. i erecta he asta ta 33 120 14 34 120 16 
16 een EU enn rate 10 106 12 14 107 12 
17 cpesseeen Sapmninansateets 37 116 12 34 113 14 
18 NE LER eee ere 36 127 16 36 127 16 
AR ter te La an eee 35 103 12 37 101 11 
20... UENCE SERS See 26 133 18 27 133 18 
21 RE eee RES ere 33 124 13 36 122 16 
SREP EES opener oe URAL E BRO re 32 123 12 39 120 12 
BG ch nig fa aista ios aa Soe 26 123 16 29 133 16 
24 cca cccecm ted: dns 26 123 16 29 133 16 
25 ea ate $1 135 16 39 119 16 
: oe pitas: 28 114 16 35 112 13 
27 ee eRe ee err ne 27 118 13 18 119 13 
an PS eT 27 110 14 18 113 16 
29 BN ARE LS Sine a 57 95 14 16 100 12 
50 BRN eS An Oe 26 124 14 30 129 12 
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tering Tests of Mental Ability, was 
from 90 to 135, with an average for 
the homosexual group of 115.4 and 
for the heterosexual group of 116.2. 
In education the range was from com- 
pletion of grammar school to the 
equivalent of a master’s degree, with 
an average for the homosexual group 
of 13.9 years and for the heterosexual 
group of 14.3. 

In both groups subjects were elim- 
inated who were in therapy at the 
time. If, in the preliminary screening, 
evidence of considerable disturbance 
appeared, the individual was elimin- 
ated (5 heterosexuals; 5 homosexuals). 
I attempted to secure homosexuals 
who would be pure for homosexual- 
ity; that is, without heterosexual ex- 
perience. With three exceptions this 
is so, These three subjects had not 
had more than three heterosexual ex- 
periences, and they identified them- 
selves as homosexual in their patterns 
of desire and behavior, The hetero- 
sexual group is exclusively heterosex- 
ual beyond the adolescent period, 
with three exceptions; these three had 
had a single homosexual experience 
each. In the effort to control the pres- 
ence of homosexuality, latent or other- 
wise, in the heterosexual group, each 
potential subject was referred by a 
responsible leader of a community 
group, who described him as being a 
thorough-going heterosexual and well 
adjusted. This was an attempt to take 
precautions to eliminate as many men 
as possible with homosexual patterns 
of behavior. It did not do so, and 
some individuals came who had to 
be eliminated because, though mar- 
ried and functioning in the commun. 
ity as married men, they had had ex- 
tensive homosexual experience (four 
subjects). 

The heterosexual subjects came be- 
cause they were told that this was an 
opportunity to contribute to our un- 
derstanding of the way in which the 
average individual in the community 
functions, since we had little data on 
normal men. They were told nothing 


beforehand about the homosexual as- 
pects of the project. When an indi- 
vidual came to me, after describing 
to him the nature of the testing and 
the interview and securing his willing- 
ness to participate in the project, I 
then described very briefly the pur- 
pose of the study, including the homo- 
sexual group. It was impossible to 
avoid this explanation. The commun- 
ity leaders who referred these men 
were concerned about possible reper- 
cussions of a “sex study”. They re- 
quired that each man be informed 
that the total project involved a com- 
parison of homosexual and heterosex- 
ual men. I had, therefore, to risk the 
effect of this information upon my 
subjects. So, having very briefly des- 
cribed the project to him, I then 
asked whether he had had any homo- 
sexual inclinations or experience. 
This question was put in a matter-of- 
fact way and only after a good rela- 
tionship of cooperation had been es- 
tablished. If the individual seemed to 
be severely disturbed by the question, 
or responded in a bland way, or de- 
nied it vehemently, I did not include 
him in the sample of 30, It is possible, 
though I doubt it, that there are some 
heterosexuals in my group who have 
strong latent or concealed overt 
homosexuality. 

The materials used for the com- 
parative study of personality struc- 
ture and adjustment of these two 
groups of men consisted of a battery 
of projective techniques, attitude 
scales, and intensive life history inter- 
views. The material I am reporting 
on here is largely from an analysis of 
the Rorschach, TAT, and MAPS, 
with some references to life histories, 
the detailed analysis of which has not 
yet been, completed. 

I used the Rorschach because many 
clinicians believe it to be the best 
method of assessing total personality 
structure and, also, because it is one 
of the test instruments currently used 
for the diagnosis of homosexuality. 
The 60 Rorschach protocols were 
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scored by me, the usual tabulations 
made, and the profiles constructed. 
With all identifying information ex- 
cept age eliminated, they were then 
arranged in random order. Two clin- 
icians, who are also experts in Ror- 
schach, analyzed each of the 60 proto- 
cols separately in this order. Because 
of the importance of knowing how, by 
what process, using what evidence in 
the Rorschach, a judge arrived at his 
rating or judgment in each of the 
categories, each judge was urged to 
describe as much as he could of the 
procedure he was using, the conclu- 
sions arrived at, and the evidence 
used; and the whole process was re- 
corded by Audograph, Let it be said 
here that the task which the judges 
were asked to perform, that of anal- 
yzing 60 records in succession and of 
verbalizing the whole process, was a 
monumental one. It demanded not 
only a devotion to science “beyond 
the call of duty” but also an admir- 
able willingness to expose one’s falli- 
bility. My success in persuading Dr. 
Klopfer and Dr. Mortimer Meyer, for 
the Rorschach, and Dr. Shneidman, 
for the TAT and MAPS, to give so 
generously of themselves in this pro- 
ject was primarily due to their belief 
in its importance and to their eager- 
ness to see a unique body of material 
and to engage in what they antici- 
pated to be a rewarding learning ex- 
perience. 

The purpose of the Rorschach an- 
alysis was two-fold: (1) to obtain an 
unbiased judgment (that is, without 
knowledge of homosexual or hetero- 
sexual identification of subjects and 
without life-history materials) of per- 
sonality structure and overall adjust- 
ment of the subjects in both groups; 
(2) to determine the accuracy with 
which expert clinicians who are Ror- 
schach workers can _ differentiate 
homosexual from heterosexual rec- 
ords, Each judge was asked, in addi- 
tion to the overall adjustment rating, 
to analyze the Rorschach protocol in 
terms of a number of categories, such 
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as methods of handling aggression, 
affection and dependency needs, meth- 
ods of impulse control, and clinical 
label, if any. These judgment cate- 
gories were used because of their the- 
oretical importance in current ap- 
proaches to homosexuality. The ad- 
justment rating was on a five-point 
scale: from 1, superior, to 5, malad- 
justed; with 3 representing average 
adjustment. The norm which the 
judges used was, of course, a subject- 
ive one, of average adjustment in the 
population at large, not just in this 
group. Assigning an adjustment rat- 
ing to a Rorschach protocol is diffi- 
cult, as all of us know. The meanings 
of the five points of the rating scale 
were defined as follows: (1) superior, 
or top adjustment; better than the 
average person in the total popula- 
tra; e.idence of superior integration 
of capacities, both intellectual and 
emotional; ease and comfort in rela- 
tion to the self and in functioning 
effectively in relation to the social 
environment; (3) as well-adjusted as 
the average person in the total popu- 
lation; nothing conspicuously good 
or bad; (5) bottom limit of normal 
group and/or maladjusted, with signs 
of pathology. Ratings 2 and 4 are 
self-evident, 2 being better-than-aver- 
age but not quite superior, and 4 
being worse-than-average, or the bot- 
tom limit of the average group. These 
ratings are very difficult to objectify, 
and it is very difficult to be sure that 
they were used in the same way by 
the two judges. 

One further comment about proced- 
ure, before discussing the results of 
the judging on adjustment: each 
judge, before he began, knew that 
some records were homosexual and 
some were heterosexual. Most clinici- 
ans in the Los Angeles area are fam- 
iliar with the project, and it would 
have been impossible to secure ex- 
perts without some knowledge of it. 
The judge was told that the oppor- 
tunity to distinguish homosexual 
from heterosexual records would 
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TABLE I]—Ratings on Overall Adjustment—Rorschach 


Group 
Judge “A” Homosexual. 
Heterosexual 
Total 
Judge “B” Homosexual 
Heterosexual 
‘POtai...... 


come later and that the present task 
was that of telling me as much as he 
could about what he thought the sub- 
ject to be like in personality struc- 
ture and adjustment. If anything im- 
pressed him about the pattern of sex- 
ual adjustment, he should say it, but 
this was not the primary purpose of 
this stage of the analysis. The task of 
the judges was broken down into two 
steps: (1) The protocols were anal- 
yzed, with overall adjustment ratings 
given and summary judgments made, 
in the categories already described; 
and (2) each judge was then present- 
ed with 30 pairs of protocols, matched 
for age, education, and IQ, the task 
being to distinguish the homosexual 
record in each pair. 

The results of the judging of adjust- 
ment from the Rorschach protocols 
are presented in Table IT. 


It will be noted that there are no 
significant differences between the 
number of homosexuals and hetero- 
sexuals having a rating of 3 and better 
for each judge; two-thirds of each 
group are assigned an adjustment rat- 
ing of 3 or better, There are apparent 
differences between judges. For Judge 
“B” there is a greater unwillingness 
to assign a top rating. In fact, for 
Judge “B”, there is a slight but in- 
significant trend in the direction of 





Ratings 
(Top) (Bottom) 

] 2 3 4 5 

9 9 1 3 5 

6 12 5 3 i 
15 a 9 "6 9° 

> 4 15 5 4 4 

y 8 9 8 3 
a “23° i 12 i 


superior adjustment for the homosex- 
ual group. By the method of “grand 
medians”, chi square for Judge “A” 
is zero for the differences in adjust- 
ment between heterosexuals and 
homosexuals and for Judge “B” the 
difference is 2.31, which is insignifi- 
cant. 

The immediate question is the de- 
gree of agreement between the two 
judges. Although a Tschuprow coef.- 
ficient between the ratings of Judge 
“A” and Judge “B” is only 0.33, it is 
important to point out that the situ- 
ation is not as bad as this low coef- 
ficient would seem to indicate. 

Table III shows that the two judges 
agreed exactly in 19 of the 60 cases, 
8 being homosexual and 11 hetero- 
sexual. In 23 cases they disagreed by 
one rating step, 12 of these being 
homosexual and 11 heterosexual. This 
means that in 42 out of the 60 cases 
there was either exact agreement or 
disagreement by only one step. So 
it is safe to say that in two-thirds of 
the total distribution there is high 
agreement. An additional fact that 
may be pointed out is that 14, or ap- 
proximately one-half, of the homo- 
sexuals were placed either in Adjust- 
ment Rating | or 2 by both judges. 

How is one to interpret this find- 
ing? Is one to take it at face value and 


TABLE ITI 
Number of Subjects 
Differences Total Homosexual Heterosexual 
0 (exact agreement) 19 8 1] 
1 rating step. 23 12 11 
2 rating steps...... 14 7 7 


3 rating steps 
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assume that the Rorschach is a valid 
instrument for determining adjust- 
ment in the way in which we have 
defined it? If so, then clearly there is 
no inherent connection between path- 
ology and homosexuality. But caution 
is needed, As clinicians, we are well 
aware, in daily practice, of the limi- 
tations of projective material anal- 
yzed “blind”, Nevertheless, the quan- 
titative results are striking, and they 
are confirmed in part by observations 
of the judges, as well as—and I say 
this with great caution — by _life- 
history data. 

But let us look at the results in the 
second task given the judges, that of 
distinguishing between matched pairs 
of homosexual and heterosexual rec- 
ords. This is a much easier task than 
that which the clinician ordinarily 
faces, of identifying homosexuality 
in one record out of many; and yet 
it proved to be a very difficult one. 
As a judge compared the matched 
protocols, he would frequently com- 
ment, “There are no _ clues;” or, 
“These are so similar that you are 
out to skin us alive;” or, “It is a forced 
choice;” or, “I just have to guess.” The 
difficulty of the task was reflected not 
only in the comments of the judges 
but also in the results. Judge “A” cor- 
rectly identified 17 of the 30 pairs, and 
Judge “B” 18 of the 30. Thus neither 
judge was able to do better than 
chance. In seven pairs both judges 
were incorrect, that is, identifying 
the homosexual as the heterosexual, 
and vice versa; in twelve pairs, cor- 
rect; and in the remaining eleven they 
disagreed. 

Let us look at the problems the 
judges faced. In some pairs of records 
none of the clues usually considered 
to be signs of homosexuality occurred. 
In some pairs the “homosexual clues” 
appeared in both records. These 
“homosexual clues” were primarily 
anality, open or disguised; avoidance 
of areas usually designated as vaginal 
areas; articles of feminine clothing, 
especially under-clothing, and/or art 


objects elaborated with unusual de- 
tail; responses giving evidence of con- 
siderable sexual confusion, with cas- 
tration anxiety, and/or hostile or fear- 
ful attitudes toward women; evidence 
of feminine cultural identification, 
and/or emotional involvement be- 
tween males. When these clues ap- 
peared in neither or in both records, 
the judge was forced to look for other 
evidence, and most frequently de- 
pended upon peculiar verbalization, 
or responses with idiosyncratic mean- 
ing, or the “flavor” of the total rec- 
ord. When careful examination failed 
to reveal anything distinctive, the 
judge assumed that the more banal 
or typical record was that of the het- 
erosexual, an assumption which was 
sometimes false. 

After the judging was completed, 
and, indeed, even while it was in pro- 
cess, both judges commented on the 
fact that the records which they 
thought to be homosexual were un- 
like the ones they were familiar with 
in the clinic. They were not the dis- 
turbed records ordinarily seen. One 
judge, in the process of choosing, 
said, “It begins to look as if the homo- 
sexuals have all the good things: for 
example, M’s and Fe.” It may be 
pertinent to reiterate that I had made 
an effort to secure records of homo- 
sexuals who ordinarily would not be 
seen in a clinic. A discussion of the 
validity and reliability of homosexual 
signs is tangential to this symposium+, 
but I would point out in passing that 
my data indicate the need for a thor- 
ough-going reconsideration of — this 
problem. At a minimum, healthy 
skepticism about many (but not all) 
so-called homosexual-content signs in 
the Rorschach is, I think, called for. 
The inability of the judges to dis- 
tinguish the homosexual from the 
heterosexual records better than 


*A paper on “Homosexuality in the Ror- 
schach” is in process of preparation. It will 
contain a full discussion of homosexual 
signs, as well as other aspects of homo- 
sexualitv in the Rorschach. 
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would be expected by chance fits, I 
think, the finding on adjustment of 
the two groups. Some of the records 
can be easily distinguished; the fact 
that the judges agreed in their identi- 
fication of twelve pairs indicates this. 
These were records of individuals 
with strong emphasis on “femininity” 
and/or anality. But apart from these, 
which constitute about a third of the 
group, the remaining two-thirds can- 
not be easily distinguished. If the 
homosexual records had been  simi- 
lar to those frequently seen in the 
clinic, that is, severely disturbed, there 
might have been greater probability 
that they could have been correctly 
identified, although this cannot be 
said with certainty. I have now seen 
about two hundred homosexual rec- 
ords and would be skeptical about my 
ability to identify correctly records 
similar to many in this group. 

Although it is not pertinent to this 
symposium® to present in detail the 
findings of the statistical compari- 
sons of the two groups of Rorschach 
protocols, it is relevant to point out 
in summary form that most of these 
comparisons have failed to produce 
differences of sufficient magnitude to 
satisfy tests of significance. Several 
examples will suffice to make the 
point, Although most studies of homo- 
sexual protocols indicate greater pro- 
ductivity on the Rorschach, the dif- 
ference between the two groups in 
the present study does not reach sig- 
nificance, though there is a trend in 
this direction (t=1.389, df= 29, p= 
>.10). A detailed comparison of total 
M’s and human figures was made. Of 
some 25 computations, of differences 
between means of M% in various cate- 
gories (such as flexor or extensor), 
differences in form level, variation in 
form level, etc., the only ones which 
approached low significance were the 
sigma of form level (t=1.98, df=29, 

=>.05), and O-minus percent (t= 
2.262, af=29, p=: < 82). 

Cronbach’s warning about inflation 


* See Footnote 4. 





of probabilities deters me from draw- 
ing too many conclusions from these 
two findings, although there is good 
theoretical rationale for them. The 
details of the analysis will be discussed 
more appropriately in a later paper. 
I cite these genéral findings at this 
time in order to show that despite 
considerable effort and the pursuing 
of many alluring possibilities, the et- 
ferts thus far to establish clear-cut dif- 
ferences between the two groups as 
a whole have been relatively fruitless. 
This, too, is consistent with the lack 
of significant differences between the 
adjustments of the two groups. 

In addition to the overall adjust- 
ment ratings, each judge gave sum- 
mary statements about each subject 
in a number of categories, including 
methods of handling aggression, af- 
fectional and dependency needs, and 
form of impulse control, When these 
statements were tabulated and sub- 
jected to statistical analysis, again 
no clear-cut differences emerged.* For 
example, the statements about affec- 
tional and dependency needs have 
been tabulated in eleven categories, 
such as repressed or absent, ego-alien, 
integrates well, controlled by (that is, 
a dependent character). Four homo- 
sexuals were described as having af- 
fectional and dependency needs re- 
pressed or absent, while three hetero- 
sexuals were similarly described. Six 
homosexuals and six heterosexuals 
were described as integrating well 
these needs. It was said of one homo- 
sexual and one heterosexual that af- 
fectional and dependency needs were 
ego-alien. Chi square for differences 
between the number of heterosexuals 
and homosexuals assigned to all cate- 
gories is 5.736, df—10, insignificant. 

Let us turn now to the TAT and 
MAPS. These were administered as a 
single test, the selected MAPS items 
following the TAT. Altogether, 12 
pictures were used: 3BM, 6BM, 7BM, 
12M, 13MF, 16, and 18GF of the 


®* The complete data will be reported in the 
future publication previously referred to. 
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Tas_e 1V—Adjustment Ratings on MAPS-TAT 


Group 
Paomnneenal...........:.....:..... 
Heterosexual 

Potal. 


TAT; and from the MAPS, the Liv- 
ing Room, the Street Scene, the Bath- 
room, the Bedroom, and the Dream. 
It was hoped that the TAT and 
MAPS would be helpful in revealing 
current conflicts. The MAPS was used 
in addition to the TAT because of 
the opportunity it gives the subject 
for the selection of figures together 
with backgrounds with different situ- 
ational pulls of particular importance 
in this study, Very fortunately, Dr. 
Shneidman agreed to analyze the 
MAPS and TAT protocols of the 60 
subjects, using the same categories for 
analysis and overall adjustment as did 
the Rorschach judges. The service he 
performed, in terms of sheer energy 
alone, may be suggested by the fact 
that he began the task on week-ends 
in February, when the first fruit trees 
in our California garden were in 
bloom, and barely escaped before 
fruit appeared in July. The problem 
of identifying the homosexual proto- 
col from this material was essentially 
a much easier one than that encount- 
ered with the Rorschach, since few 
homosexuals failed to give open homo- 
sexual stories on at least one picture. 
The second task given ‘the Rorschach 
judges, of distinguishing the homo- 
sexual from the heterosexual records 
when they were presented in matched 
pairs, was therefore omitted. In every 
other respect, however, both with re- 
spect to task and procedure and in- 
cluding the recording, the TAT- 
MAPS judge proceeded as had the 
Rorschach judges. In the first 30 rec- 
ords the TAT and MAPS protocols 
for each man were analyzed together, 
With judgments given about overall 
adjustment rating and the other cate- 
gories, such as methods of handling 
aggression, etc. In the second 30 rec- 


Ratings 
(Top) (Bottom) 
1 2 3 1 5 
0 9 15 6 0 
0 7 19 3 1 
: 16 34  e 7 


ords, the TAT protocols were ana- 
lyzed in succession, with judgments 
given, and then the MAPS—the judge 
not knowing which MAPS protocol 
corresponded with which TAT. This 
was done in an effort to prevent a 
“halo” effect, since homosexuality was 
openly revealed in some TAT records 
and not in the MAPS (for the same 
man), and vice versa. Some very in- 
teresting results were obtained, to 
which I shall refer later. 

Table II] shows the data on the ad- 
justment ratings. The results are es- 
sentially the same as for the Ror- 
schach. The homosexuals and hetero- 
sexuals do not differ significantly in 
their ratings: Chi square = 2.72, df 
= 4,p = > .70. This judge does not 
place a single subject in Rating 1, 
and he places only one in Rat- 
ing 5. (a heterosexual). Determining 
the degree of agreement between 
the ratings on the Rorschach 
and TAT-MAPS constitutes a difficult 
problem, since two variables are in- 
volved: the judges and the test mate- 
rials. A Tschuprow coefficient between 
either Rorschach judge and the TAT- 
MAPS judge is 0.20. Perhaps a more 
meaningful way of looking at the ma- 
terial is that between one Rorschach 
judge (Judge “A”) and the TAT- 
MAPS judge there is exact agreement 
in 15 of the 60 cases (8 homosexual 
and 7 heterosexual); for Judge “B” 
there is agreement in 16 cases. When 
the ratings of all three judges are put 
together, there is agreement on 14 
homosexuals (approximately one-half 
of the group) as being 3 or better in 
adjustment, and 14 heterosexuals.? 


7A paper on “Homosexuality in the TAT 
and MAPS,” which will contain the full re- 
port, is in process of preparation, 
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Let me turn now to some qualita- 
tive descriptions of the homosexuals 
from the projective material. Perhaps 
even better than do the quantitative 
results, these will convey the problem. 
Man #16 is described by one judge 
in summary fashion as “an individual 
who has the most superb and smooth 
mastery of intellectual processes we 
have seen. Intellectualization is his 
major defense, although there is no 
compulsive flavor. On one side there 
is isolation of aggression. But essen- 
tially he is submissive, and since he is 
so sensitive and responsive, he cannot 
give in to the submissive seduction. 
His dependency needs are filtered and 
sublimated, He is the ethical type. In- 
tellectual introspection must be his 
major preoccupation. He is really bal- 
anced on a razor’s edge. An extremely 
clever person.” He was correctly iden- 
tified by this judge, who gave him a 
rating of 1, and incorrectly by the 
other judge, who placed him in Rat- 
ing 2. The latter describes him in the 
following terms: “He gives an origin- 
al twist to ordinary things. For him it 
is very important not to be conven- 
tional. He avoids it like the plague. 
He tries to keep it cool. I get the feel- 
ing that he wants to deny dependency. 
He has passive longings, but these 
would not fit in with his ego-ideal of 
being strong, superior, and wise. He 
would be able to be very rewarding 
emotionally. He does not wish to ex- 
pose his aggression ordinarily, but 
would in relation to manly intellec- 
tual pursuits, I think he is heterosex- 
ual.” 

This man is described on the 
MAPS and TAT as being “the most 
heterosexual-looking homosexual I 
have ever seen. Up to the last two 
stories on the MAPS, I would say con- 
fidently, ‘This is a heterosexual rec- 
ord.” His attitudes to sexuality are fair- 
ly moral. He has refined, quiet rela- 
tionships to people. I would give him 
a rating of 2. The unconscious con- 
flicts are very deep, but they are not 
disturbing clinically. No idea of clin- 
ical label. I would not have known he 
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is a homosexual except for a ‘give 
away’ on two of the MAPS stories.” 

This man is in his early 40’s and 
holds two master’s degrees in different 
artistic fields from one of the major 
educational institutions of this coun- 
try. He had a long career as a college 
teacher—long, and apparently success- 
ful. He was caught in what was, to 
the police, suspicious circumstances 
with another man, and in the space of 
a few minutes his entire professional 
career was destroyed. He now is the 
manager of a magazine. Although in 
his early life he passed through the 
“cruising” stage, he now has highly 
steble personal relationships, includ- 
ing « “homosexual marriage.” If one 
brackets the fact that he is a homo- 
sexual, one would think of him as 
being a highly cultured, intelligent 
man who, though unconventional in 
his manner of living, exhibits no par- 
ticular signs of pathology. He has 
never sought psychological or psychi- 
atric help. He has been a homosexual 
fro:n adolescence, with no heterosex- 
ual experience or inclination. 

Let me describe another (Subject 
#50) of these individuals who was 
placed in adjustment categories | or 
2 by both Rorschach judges and mis- 
identified as being a heterosexual. One 
judge described this man “as being so 
ordinary that it’s hard to say anything 
specific about him. His impulse con- 
trol is very smooth, He uses channeli- 
zation rather than repression. Except 
for a little too much emphasis on con- 
quest in heterosexual relations, he is 
well adjusted and smooth. His aggres- 
sive impulses are expressed in phallic 
gratification. Good fusion of tender- 
ness and aggression, though he subju- 
gates tenderness to phallic gratifica- 
tion. He must be a heterosexual. | 
would really have to force myself, to 
think of him as not heterosexual.” By 
the second judge this man is described 
in the following terms: “He must be a 
very interesting guy. He must convey 
comfort to people. He takes essen- 
tials and doesn’t get lost in details. 
A solid citizen, neatly and solidly in- 
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tegrated, with no specific defenses. 
Neither aggression nor dependency is 
a problem. I think that this man is 
heterosexual.” 

Man #50 is twenty-seven, He works 
in the electronics industry, in a very 
large firm in which he has a super- 
visory job. He lives alone in an apart- 
ment, though in an apartment house 
in which other homosexuals reside. 
His homosexual pattern involves 
rather a large number of homosexual 
partners. He is thoroughly immersed 
in the homosexual way of life, but 
apart from this I see no particular 
evidence of disturbance. 

The TAT was analyzed first, and 
on the TAT he talks about homosexu- 
ality, thus revealing that he is a homo- 
sexual. The judgments to which the 
clinician comes are essentially that he 
is a promiscuous, driven person; that 
there are compulsive elements; that 
he goes from one relationship to an- 
other, not even aware of what he is 
seeking, a fairly lonely man, although 
with an adjustment slightly below 3. 
The first four stories of the MAPS 
were described by the judge as being 
definitely heterosexual. On the last 
story, the Dream, I should like to 
quote the judge directly: “I am sur- 
prised, because what this means is that 
this is the record of a homosexual; 
and it means that I had not seen this 
at all up to this point. It means, also, 
that he doesn’t show it except over the 
jealousy and rivalry of homosexual 
partners. The record is clean psychi- 
atrically up to this point. It wasn’t 
especially rich, but it would certainly 
pass. I don’t want to do fancy equivo- 
cation and say I see it all now, be- 
cause I don’t see a damn thing now. 
The Living Room is fine; it is as het- 
erosexual as any story we have read in 
the entire series. The Street Scene 
simply shows the derogatory and dis- 
dainful attitudes that many hetero- 
sexual men have toward female sexu- 
ality. It is not the exclusive approach 
of the homosexual, though it is con- 
sistent with it. It has a heterosexual 
flavor. In the Bath, the privacy of the 


father is interrupted, but this, if any- 
thing, would be heterosexual. The 
sedroom is as normal a heterosexual 
story as I have ever read.” The judge 
re-reads the story: “This is almost an 
encapsulated homosexual. I don't 
know if I am just being fancy, but we 
talk about a guy sometimes who func- 
tions fairly well until you mention 
‘Republican’ or ‘Communist’, then 
you plug in a whole series of paranoid 
and delusory material; at this point 
the guy is just crazy. This guy has an 
encapsulated homosexual system. If 
I had not been shown the Dream 
story, | would have bet 85 to 15 that 
he was heterosexual, and maybe even 
more. I also feel that this guy is a 
male homosexual. He plays the ag- 
gressive, masculine role. But I am 
puzzled. I can hardly speak intelli- 
gently of the dynamics of the homo- 
sexuality when, until the last moment, 
I thought of him as heterosexual. | 
would give him a rating of slightly 
better than 3, Not a rich record; not 
creative and imaginative. It’s a rather 
perfunctorily heterosexual record. | 
am amazed at this record. He has in- 
tense involvement with people. He is 
not a promiscuous homosexual. There 
is strong affect. He practically acts like 
a husband and father. One of the 
statements about him is that he is a 
normal homosexual. I mean it’s like a 
guy who has a tic: ordinarily we say 
he must have a very serious problem. 
Maybe he does, but if you examine 
the material of lots of people who 
have tics, you will find some people 
who look pretty good, if you think of 
normal functioning. Then, after you 
have said this, someone tells you, ‘Yes, 
but he is one of the guys who tics.’ 
And you say, “Well, he looks clean to 
me.’ And that is what this record 
looks like. This record is schizophre- 
nic like I am an aviator. If you want 
proof that a homosexual can be nor- 
mal, this record does it.” 

Man #49 is described by Judge “A”’ 
as follows (Rating 1): “This record 
presents less problems of any sort than 
any other we have seen. The mental 
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type is very clear-cut, calling a spade 
a spade. Looks like a well-integrated 
person. Impulse control really smooth, 
because he permits all impulses to ex- 
press themselves in a context — both 
dependent and aggressive. Of all the 
cases, the best balance of aggression 
and dependency we have seen. No 
problem, clinical or otherwise. Rela- 
tions with others skilful and comfort- 
able.” Judge “B” (Rating 2; if not 2, 

1): “Able to integrate well with all 
stimuli. Effective functioning. Hetero- 
sexual adjustment. Defense used: 
some repression. Not an ‘acter outer.’ 
Avoids intense emotional stimuli be- 
cause they are disorganizing to him.” 

The TAT and MAPS were analyzed 
separately, In the first four stories of 
the TAT, the subject was described 
as being a thorough-going heterosex- 
ual. In 13MF the judge comments, 
“Here we have a fairly straightfor- 
ward heterosexual story.” In the blank 
card in the TAT, the judge says, 
“Here this guy opens up more than 
on the others. He is a sleeper. This 
is one of the best-adjusted and, in a 
sense, one of the most paradoxical rec- 
ords I have seen, What is here is in- 
decision and a schizoid feeling. So 
this is not in any sense a superior per- 
sonality. There is some withdrawal 
and some aridity. This is not an out- 
going, warm, decisive person. It is 
a constricted, somewhat egocentric, 
somewhat schizoid, perturbed, a little 
guilty fellow. Even so, it is not a tor- 
mented record and is not necessarily a 
homosexual record. He talks about 
this quite casually and has a fairly 
good adjustment to his homosexuality. 
This guy is a very interesting person 
and quite a complicated guy. In many 
ways he is both well adjusted to his 
homosexuality and the kind of guy 
who could almost be heterosexual in 
a way that other homosexuals could 
not be. I don’t think he would be 
swishy or over-masculine. He would 


pass. I find him very difficult to rate. 
I can’t rate him as | or 2. To call him 
average is innocuous. He doesn’t merit 
I don’t know. 


5 or 4 I will call him 





3, but it doesn’t give the flavor. I 
don’t know what to do.” 

At another time the same judge 
analyzed the MAPS protocol, in which 
no homosexual stories are given. The 
judge comments: “I want to comment 
on his insistence on the normal situa- 
tion and his freedom to use the nude. 
I think this is a very healthy guy, in a 
somewhat barren way. I have a feeling 
that this is a kind of emancipated per- 
son who has not made an issue of be- 
ing independent but is able to stand 
on his own two feet. The fact that he 
doesn’t have rich dynamics robs him 
of being interesting, creative, and un- 
usual. I rate him as a 2 for sure, I 
don’t know what a 1 would be. He 
handles hostility and sexuality easily. 
One shortcoming in the record—not 
pathological—is the conventionality; 
and I imply by that a touch of empti- 
ness. He is able to love and to dislike. 
He is a good father and husband and 
would be a steady employee. I could 
see him as having a better-than-aver- 
age job. He would not be a creative or 
imaginative person. I don’t mean a 
Babbitt, but he would not take the 
risk of loving deeply. He is a middle- 
of-the-roader. This is as clean a rec- 
ord as I think I have seen. I don’t 
think he has strong dependency needs. 
He is comfortable, and in that sense 
he is strong. I imply that this is a 
hetercsexual record specifically.” 

This man is 37, and he works in a 
ceramics factory doing fairly routine 
work. He has a “homosexual mar- 
riage” of some six years’ duration. He 
tried very hard to change his sexual 
pattern but was unsuccessful and has 
now accepted the homosexual “life.” 
He has not had heterosexual experi- 
ence. 

Out of the 30 homosexual men, 
there were seven who were placed by 
one or the other judge in rating cate- 
gories 4 or 5. Since these individuals 
have what is probably the more ex- 
pected personality picture, I should 
like to describe several. One of these 
is +6. He was rated by one judge at 
a 5 level and by the other judge at 2. 
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By the judge who places him at 5, he 
is described as a “‘pseudo-normal, near- 
psychotic, with brittle personality or- 
ganization which is fairly stabilized. 
His reality testing is uncannily sharp, 
but he is almost autistic. His chief de- 
fenses are projection and intellectual 
control. There are strong castration 
fears, strong orality, and the aggres- 
sion is projected or transformed into 
irony. The emotional needs are with- 
ered away.” 

Man +52 is described by one judge 
whe places him in the 4 category, as 
“a personality which is basically path- 
ological. An anal character, with a 
strongly destructive flavor. Anal-sa- 
distic. A past-master of intellectualiza- 
tion, though superficially socializes it. 
Just enough reality testing to be clin- 
ically normal. Impossible to separate 
the hysterical and paranoid elements. 
Dependency needs are repressed or 
crippled, Very narcissistic and inca- 
pable of guilt. A cloak of righteous- 
ness over it all.”” The second judge de- 
scribes him in the following terms: 
“There is too much unconscious 
breaking through. Some ideational 
leakage. A chronic situation to which 
he has made an adjustment. He is not 
paranoid, but obsessive in a paranoid 
structure. On the surface he operates 
smoothly. Emotional relationships will 
lack in depth and warmth. Uses over- 
ideation as a defense. His primary 
method is intellectualization, His de- 
pendency needs will make him appear 
demanding. Essentially a character 
picture.” 

Of a somewhat different nature is 
+28, who is placed by both judges at 
the bottom level of adjustment. De- 
scribed by one judge as “very defen- 
sive; every impulse ego-alien. Uses de- 
nial, intellectualization, and _ repres- 
sion. High level of narcissism. Re- 
gresses easily into the infantile. The 
most unbalanced record one could 
find.” By the other judge: “This looks 
like a clinic record. An anxiety state, 
pre-psychotic. Is more scared of his 
own fantasies than the world. People 
present too many problems; he tries 
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to preserve distant relations. Doesn't 
want to see sex in people. Sex is very 
repulsive.” 

Thus, there is no single pattern of 
homosexual adjustment. This had 
been anticipated. The richness and 
variety of ways in which the homo- 
sexual adjusts are as difficult to sum- 
marize as to summarize 30 full, quali- 
tative pictures of 30 individuals, If I 
were to read pictures of heterosexuals 
with the same level of adjustment, the 
pictures would be essentially the same, 
with the exception of the bottom 
range, where one does not find the 
marked anal-destructive character- 
structure or the emphasis on “femin- 
inity” (which may occur at other 
levels, also), 

That homosexuality is determined 
by a multiplicity of factors would not 
now, I think, be seriously questioned. 
That the personality structure and ad- 
justment may also vary within a wide 
range now seems quite clear. It comes 
as no surprise that some homosexuals 
are severely disturbed, and, indeed, so 
much so that the hypothesis might be 
entertained that the homosexuality 
is the defense against open psychosis. 
But what is difficult to accept (for 
most clinicians) is that some homo- 
sexuals may be very ordinary individ- 
uals, indistinguishable, except in sex- 
ual pattern, from ordinary individu- 
als who are heterosexual. Or—and I do 
not know whether this would be more 
or less difficult to accept—that some 
may be quite superior individuals, not 
only devoid of pathology (unless one 
insists that homosexuality itself is a 
sign of pathology) but also function- 
ing at a superior level. 

But before we accept this hypoth- 
esis as a plausible one, we must look 
carefully at the limitations of the evi- 
dence. We have already spoken of the 
necessity of caution in accepting as 
valid the results of “blind” analyses 
of projective test protocols. As clin- 
icians, we are also cautious about ac- 
cepting an analysis which is not 
“blind.” It may be that the primary 
psychological defect, if there is one, in 
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the homosexual lies in a weakness of 
ego-function and control and that this 
cannot be adequately diagnosed from 
projective test protocols. As one psy- 
chiatrist puts it, the material pro- 
duced in the Rorschach is like that 
produced on the analytic couch. Two 
men may produce very similar mate- 
rial on the couch, but the difference 
between them is that one—the normal 
—gets up at the end of the hour and 
resumes his normal functioning, while 
the other does not. Another way ol 
looking at the data from the projec- 
tive tests may be that the homosexual 
“pathology” occurs only in an erotic 
situation and that the homosexual can 
function well in non-erotic situations 
such as the Rorschach, TAT, and 
MAPS. Thus, one could defend the 
hypothesis that homosexuality is 
symptomatic of pathology, but that 
the pathology is confined to one sec- 
tor of behavior, namely, the sexual. 

As I listened to each of the three 
judges analyze the 60 records, I was 
very much impressed with the useful- 
ness of the projective tests, when in- 
terpreted by expert clinicians, Often, 
the picture of the personality which 
emerged bore such a striking resem- 
blance to the man as I knew him from 
many hours of interviewing and test- 
ing that it was difficult to believe that 
the judge did not have detailed per- 
sonal knowledge as well. Of course 
there was great discrepancy in some 
cases. The full report of the material 
will contain all of the evidence of the 
congruency or lack of congruency be- 
tween the life-history materials and 
the projective analysis. 

When I speak of the life-history ma- 
terials, 1 am highly conscious of the 
fact that these have not been object- 
ively rated for adjustment. This pre- 
sents a problem for the future simi- 
lar to that of the TAT and MAPS, 
only more so because of the difficulty 
of controlling for theoretical bias in 
judging open homosexual material. 
Final conclusions cannot be drawn 
until this is done. It can now be said 
with some certainty, however, that at 


least in one respect the life-history 
data from the two groups will differ: 
namely, in the love relationships. 
Comparisons between the number and 
duration of love relationships, cruis- 
ing patterns, and degree of satisfac- 
tion with sexual pattern and the love- 
partner will certainly show clear-cut 
differences. 

A question also arises about the 
size of the sample used. It is possible 
that much larger samples—for exam- 
ple, 100 in each group—would show 
differences. But would we not, in this 
case, be dealing with a different ques- 
tion, namely, “How many homosexu- 
als, as compared with heterosexuals, 
are average or better in adjustment, 
and how many are worse than aver- 
age?” It seems to me that for the pres- 
ent investigation the question is 
whether homosexuality is necessarily a 
symptom of pathology. All we need is 
a single case in which the answer is 
negative. 

What are the psychological impli- 
cations of the hypothesis that homo- 
sexuality is not necessarily a symptom 
of pathology? I would very tentatively 
suggest the following: 

1. Homosexuality as a clinical entity 
does not exist. Its forms are as 
varied as are those of heterosexu- 
ality. 

2. Homosexuality may be a deviation 
in sexual pattern which is within 
the normal range, psychologically. 
This has been suggested, on a bio- 
logical level, by Ford and Beach 
(2). 

3. The role of particular forms of 
sexual desire and expression in per- 
sonality structure and development 
may be less important than has fre- 
quently been assumed. Even if one 
assumes that homosexuality repre- 
sents a severe form of maladjust- 
ment to society in the sexual sector 
of behavior, this does not neces- 
sarily mean that the homosexual 
must be severely maladjusted in 
other sectors of his behavior. Or, if 
one assumes that homosexuality is 
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a form of severe maladjustment in- 
ternally, it may be that the disturb- 
ance is limited to the sexual sector 
alone. 
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Childhood Memories as a Projective on 


MARTHA GLASSMAN LIEBERMAN 
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The significance of earliest child- 
hood memories has long been recog- 
nized in psychology, although the 
various theoretical viewpoints of in- 
dividual authors have determined the 
particular frame of reference in which 
they were interpreted. According to 
Freud (8, 9), the early recollections 
which were elicited by patients dur- 
ing analysis served as “concealing 
memories,” or a substitute for other 
anxiety producing situations whose 
content was repressed. He pointed out 
their manifest innocuous and _indif- 
ferent quality, as contrasted with the 
richness of the actual childhood ex- 
periences. Their origin was suggest- 
ed by Fenichel (7), who related these 
memories to the ego’s struggle be- 
tween acknowledgment and denial of 
unpleasant facts.1 This repression rep- 
resented a progressive forgetting of 
infantile sexuality that cannot be in- 
tegrated in the developmental proc- 
ess with the greater realization of 
reality and the demands of the super- 
ego. To protect the individual from 
full cognizance of the anxiety pro- 
voking content, these substitute mem- 
ories offered to consciousness, like 
dreams (8, 9, 16), utilized the de- 
fense mechanisms of displacement, 
condensation, and symbolization.? 

Schachtel (17) suggests that if child- 
hood memories could be preserved in 
their original form, they would be 
adverse to our social civilization, 
which is not based on the primary 
pleasure principle. Because of their 
ego-disrupting content and the com- 
plex processes involved in their re- 


1“Tf in this situation, a kind of substitute 
object can be offered to perception or mem- 
ory—one which though related to the objec- 
tional fact is harmless—the substitute will 
be accepted in favor of repression.” (7) 
2“The forgetting in all cases is proved to be 
founded on the motive of displeasure.” (8) 


pression, Freud believed that only 
thorough analytic work could reveal 
insight into the memories. 


In contrast to this, Adler (1) does 
not emphasize the difficulty involved 
in their interpretation. He asserts that 
earliest childhood memories actually 
reflect the “‘style of life,” or the goal 
idea which directs the behavior of the 
individual. The memory is deter- 
mined by the necessity for adjust- 
ment.® If faced with a problem situa- 
tion, he will bring up Pn memories 
which lay the foundation for his plan 
of action. If the style of life alters, 
the earliest incidents recalled may 
change. It is also of no consequence 
whether the memories offered are 
those specifically remembered by the 
individual himself. Memories told by 
parents or relatives may be accepted 
as one’s own if they are not alien to 
the particular concept of life. 


In essence, both Freud and Adler 
relate the production of earliest 
memories to the necessity for main- 
tenance of the individual’s psychic 
equilibrium. Adler assigns a goal di- 
rective and ego stabilizing function 
to the earliest recollection, while the 
“concealing memory” described by 
Freud, serves to prevent the ego-dis- 
rupting content of the original inci- 
dent from emerging into conscious- 
ness. They both agree that the recall 
is not a chance occurrence and is mo- 
tivated by inner needs. The major 
point of difference is related to their 
direct accessibility to interpretation. 
On one hand, Freud claimed that 


* The memories represent to the person the 
“Story of my Life; a story he repeats to him- 
self to warn him or comfort him, to keep 
him concentrated on his goal, to prepare 
him, by means of past experiences, to meet 
the future with an already tested style of 
action.” The individual states, “Even in 
childhood, I found the world like this.” (1) 
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analysis of the individual’s anamne- 
sis was necessary for their interpreta- 
tion in order to gain insight into the 
original repressed content, and on the 
other, Adler stressed their direct in- 
terpretive value. To Freud, the point 
of emphasis was the underlying con- 
flictual material, while to Adler, it 
was the adjustive function and life 
goal, as reflected in the recollection. 

Greenacre (11) points out that the 
earliest memory frequently illustrates 
the “central theme” of the neurosis, 
especially when it is in the nature of 
an unpleasant event which is told 
readily by the patient, a degree of 
isolation from the disturbing content 
being achieved by an almost complete 
withdrawal of affect. This neurotic 
“theme” is generally rigidly defended 
and resists analysis. In this relation, 
Chess (4) states that the neurotic per- 
son, in striving to maintain his pre- 
carious equilibrium, must structure 
the environment in such a way as to 
preserve this tenuous balance. Brod- 
sky’s article on the “Diagnostic Im- 
portance of Early Recollections” (3), 
declares that only those memories are 
recalled that can serve as a justifica- 
tion of the individual’s approach to 
life at the time they are reproduced. 

However, relatively few studies in 
the literature directly concern the use 
of earliest memories in differential 
diagnosis. Eisenstein and Ryerson in 
1951 (6) pointed out the relation of 
the type of the first memory to clini- 
cal diagnosis of psychiatric patients. 
For example, they found that in psy- 
chosomatic disorders, the first mem- 
ory often reveals the “organ of 
choice” for the psychological expres- 
sion of anxiety. The memories of 
anxiety hysterics stress the use of dis- 
placement and symbolization as early 
defense mechanisms, while in the re- 
call of obsessive-compulsive neurotics, 
a strong prohibition is often men- 
tioned which corresponds to the 
severity of the superego indicated in 
these cases. It is also shown that the 
recollections of schizophrenics are 
often characterized by emphasis on a 
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solitary situation, one concerning 
autoerotic activity, and frankly sex- 
ual or Oedipal sexual situations. The 
authors suggest a correlation between 
earliest memories and the material 
that is revealed on the Rorschach, In 
conclusion, they state that “the first 
conscious memory is a symbol of the 
patient’s inner orientation and a dec- 
laration of his basic problems.” They 
add that it is the “clearest derivative 
of forgotten infantile conflicts.” A 
study made by Friedman (10) also 
attests to the potentialities of earliest 
memories as a diagnostic technique. 
In the recall of earliest memories by 
patients, she found differentiating 
features between those diagnosed as 
schizophrenic and neurotic. Neurotics, 
for example, are more likely to re- 
member illness in childhood with 
emphasis on over-protection and ac- 
ceptance, while the — describes 
it as an occasion of neglect and con- 
fusion. 

Earliest memories have been found 
to be a valuable addition to other test 
data. Kadis, Greene, and Freedman 
(13) illustrate the utilization of mem- 
ories as an aid in clarifying “the way 
in which a subject acts upon his lat- 
ent trends”; thereby organizing pro- 
jective material around a point of 
relevance. 

The results of the foregoing survey 
of literature indicate the need for a 
more extensive study of the value of 
the earliest memory as a projective 
technique. If it can be of value in 
facilitating a diagnostic formulation, 
it brings us closer to the goal of mak- 
ing individuals more accessible for 
understanding and therapy. 


PROCEDURE 


This study was designed to test 
the hypothesis that there is a sig- 
nificant correspondence between the 
material revealed in earliest child- 
hood memories and other projective 
data. The sample consists of 25 fe- 
male patients ranging in age from 15 
to 51 years. Psychological diagnosis 
indicated that the group was com- 
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posed of 11 psychotic and 14 non-psy- 

chotic individuals. 

A staff psychologist administered a 
full test battery to each patient con- 
sisting of the Wechsler-Bellevue, Ror- 
schach, Bender-Gestalt, and House- 
Tree-Person drawings. In addition, 
each patient was asked, “What are 
your earliest childhood memories?” 
After the patient stated her memories, 
she was specifically asked, “What is 
the earliest incident that you can re- 
member in which your mother was 
involved?” and “What is the earliest 
incident that you can remember in 
which your father was involved?” 
These earliest memories were written 
on separate sheets of paper and given 
to the experimenter. The age of the 
patient was the only additional in- 
formation received. The experimenter 
independently wrote up a_ report 
based only on the memories, and the 
staff psychologist wrote a report on 
the findings of the regular test bat- 
tery. The two reports were compared 
utilizing a check list of items consist- 
ing of descriptive terms which had 
been chosen previously and specifical- 
ly defined in order to eliminate as 
much ambiguity as possible. 

The items used to evaluate person- 
ality traits were defined on the check 
list as follows: 

I, Perception of the Environment: 
Threatening Physically — Sees the world 
as physically injurious to her well-being. 
She fears accidents or is the victim of 
physical assaults. 

Threatening Emotionally — Apprehends 
attack upon her sense of self-esteem. 
Expects other people to belittle, ridicule, 
or criticize her. 

Rejecting — The people with whom she 
desires contact tend to ignore or desert 
her. 

Friendly — Her surroundings are seen as 
accepting, and pleasant relationships are 
anticipated. 

Frustrating — The things she desires are 
denied or surrounded by barriers. Her 
wants have not been satisfied. 

Nurturing — Objects and people are 
looked toward primarily as a source of 
supplies. 


Overpowering—She feels weak in com- 

parison to the large, overwhelming world 

around her. 

Subservient — She looks down at others 

and feels above them. 

Depressing — Her surroundings are per- 

ceived as bleak, empty, and sad. 

Vague or Strange — She perceives objects 

and people as vague, distant, and unclear. 
II. Reaction to the Environment: 


Direct Aggression — Openly expresses hos- 
tility, either verbally or physically. 
Indirect Aggression — Expresses hostility 
by devious methods (“accidental” acts, 
cynicism, etc.) or by passive resistance 
(stubbornness). 

Independence — Attempts to secure her 
needs by means of her own volition. 
Dependence — Relies upon others for the 
gratification of her needs. 

Dominance — Openly tries to manipulate 
others to serve her own desires. 
Compliance — Submits to others or con- 
forms closely to conventional modes of 
behavior. 

Projection — Blames others for her diffi- 
culties or attributes her own socially un- 
acceptable desires to others. 
Intropunitiveness — Blames herself for 
misfortunes that occur. Evidence of self- 
derogation and low self-esteem. 
Withdrawal — Avoids conflict as much as 
possible. 

Reaction Formation — Prevents unaccep- 
table desires from being expressed by 
exaggerating opposed attitudes and types 
of behavior (cleanliness, moralism, etc.). 
Indecisiveness — Torn by conflict: unable 
to make decisions. 

Congeniality — Attempts to win the affec- 
tion of others by being ingratiating and 
friendly. 

Achievement — Strives to accomplish 
something recognized as a constructive 
and creditable achievement. 

Fantasy Retreat — Withdraws into fan- 
tasy in order to achieve gratification of 
frustrated desires in imaginary acts. 


RESULTS 


1. The number of check list items 
upon which both the experimenter 
and staff psychologist agreed was com- 
pared to the number of items upon 
which they disagreed. A “t” test com- 
puted to ascertain whether these two 
methods of personality analysis 
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(Earliest Childhood Memories and 
the regular test battery) are measur- 
ing the same traits was found to be 
4.65 and significant at the .001 level. 

2. The number of items checked 
using the earliest memories was com- 
pared to the number of items checked 
using only the regular test battery. A 
“t”’ test calculated to see if the amount 
of information obtained from _ the 
two methods was similar yielded a t 
of 2.94, a significant difference at the 
level of .01. 

3. The number of items checked 
using only the earliest memories was 
correlated with the number of items 
checked when the test battery alone 
was used. This was done to take into 
account the extent to which the two 
methods vary in relation to the quan- 
tity of information each yields, Ac- 
cording to the results, the r was .66, 
the critical ratio 3.3, and the level of 
significance .001. 

4. The memories were also classi- 
fied by content into several categories 
and the content of memories offered 
by the psychotic and non-psychotic 
groups was compared. Twelve cate- 
gories including such items as food, 
sex, punishment, etc., were formulat- 
ed because they were most suited to 
the range of subjects covered by the 
memories; each recollection was 
checked off in one or more categories. 
Since only a very small sample fell 


Content of Memories in Psychotic 
and Non-Psychotic Groups 
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into each content category, statistical 
analysis was not attempted, Neverthe- 
less, the data are presented below as 
suggestive of further detailed inves- 
tigation. 


DISCUSSION 


When the earliest memories and 
the psychological reports based upon 
the interpretation of a battery of pro- 
jective techniques were analyzed inde- 
pendently, there was significantly more 
agreement than disagreement in rela- 
tion to the type of material revealed. 
The amount of information elicited 
from the earliest memories also cor- 
related to a significant degree with 
the amount of information obtained 
from the psychological report. While 
it was found that significantly more 
information was received from the 
psychological report than the earliest 
memories, these memories appear ca- 
pable of serving as a rapid, valuable 
sample of the type of data likely to be 
reflected by the longer time consum- 
ing examinations. 

Although the data derived as a re- 
sult of assigning each memory to a 
content category was not subjected to 
Statistical evaluation because of the 
small sample within each of the cate- 
gories, we noted that in the psychotic 
group, memories concerning sex and 
punishment appear more frequently 
than in the non-psychotic group. On 
the other hand, non-psychotics more 
frequently give recollections that can 
be assigned to the categories “Food,” 
“Play,” and “Illness.” In this sample, 
no psychotics gave memories in the 
categories “Morality” and “Animal.” 
As a group, “Food,” “Play,” “Illness,” 
and “School” are the most frequent 
memories, and those concerning 
“Birth of a Sibling,” “Death,” and 
“Morality” are the least frequent. It 
should be emphasized again, however, 
that since no statistical analysis was 
undertaken on memory content dis- 
tribution within the psychotic and 
non-psychotic groups, these results do 
not imply a significant difference be- 
tween group frequencies. 
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SUMMARY 

The foregoing study was designed 
to compare the type and amount of 
information yielded by the earliest 
childhood memories with a regular 
projective test battery consisting of 
the Wechsler-Bellevue, Rorschach, 
Bender-Gestalt and House-Tree-Per- 
son drawings. The results indicated 
that there was a significant similarity 
between the type of content obtained 
by using the two procedures, although 
quantity of information was more 
extensive on the test battery. Differ- 
ences in type of content were also 
noted between the psychotic and non- 
psychotic groups but because of the 
limited sample falling within each 
content category, statistical analysis 
was not attempted. The advantages of 
utilizing childhood memories as a 
projective technique were the ease 
and rapidity of obtaining them as 
well as their function in serving as a 
check upon other projective materials. 
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Psychological Indices in the Selecton of Student Nurses 


HARVEY MINDEss! 
St. Mary’s Hospital, Montreal 


In order to discover the extent to 
which the Rorschach technique and 
the Wechsler-Bellevue Intelligence 
Scale might be profitably employed 
in the selection of student nurses, a 
study of one-an-one-half years dura- 
tion was carried out. The attempt 
was made to predict success in nurses’ 
training from the results of these tests 
alone. 


PROCEDURE 

Eighty girls were interviewed be- 
fore entering training. In the course 
of two or three visits, each girl was 
given an individual Rorschach and 
Wechsler-Bellevue, and a short case 
history was taken. The Wechsler rec- 
ords were scored in the usual manner. 
The Prognostic Rating Scale? was 
applied to the Rorschach protocols. 
(Since this rating scale was designed 
to measure potential ego-strength, its 
use in the present study was based on 
the supposition that ego-strength may 
play a significant part in coping with 
the stresses involved in nurses’ train- 
ing.) 

Subsequently the girls’ progress in 
training was followed for one year, 
during which time they received a 
series of grades for their academic 
work (based on objective-type exam- 
inations) and for their efficiency on 
the wards (based on subjective grad- 
ing by three supervisors). 

Product-moment correlations were 
computed on the relation of the test 


* For their work in the collecting and scoring 
of the material used in this study, I am in- 
debted to Mr. Pierre Mathieu, Mrs. Shirley 
Hallowell, and Miss Andree Lariviere. For 
her kind cooperation, I wish to thank Sister 
Mary Felicitas, Director of Nursing at St. 
Mary’s Hospital. 

* For a detailed description of the Prognostic 
Rating Scale, see J. proj. Tech., 1951, 15, 
425-428. 


scores to actual achievement as indi- 
cated by these grades. 


DESCRIPTION OF SAMPLE 


Of the 80 girls originally tested, 
12 dropped out of training within a 
few months, so our data was com- 
puted on the remaining 68. The 
group ranged from 17 to 29 years 
of age, with the great majority being 
18 or 19 years old. All except two 
girls were Catholic, and most came 
from upper middle class Canadian 
homes. All had completed high 
school, some had had a year or two 
of college, the majority had worked 
for a year or so in semi-skilled occu- 
pations (e.g. telephone operator), 
though 19 had had no work experi- 
ence. Professed reasons for entering 
nursing were un-specific, usually of 
the “It’s something I always wanted 
to do” type. 


TREATMENT OF DATA 


The case history records seemed 
barren of any prognostic material. 
Almost every girl sketched a rosy pic- 
ture of her life and denied any seri- 
ous conflicts, Consequently this in- 
formation was not utilized in pre- 
dicting success in training. 

Individual verbal and _ perform. 
ance IQ’s did not show any outstand- 
ing relationship to the various 
achievement grades, so only full-scale 
IQ’s were used in computing correla- 
tions. Nor did examination of the 
Prognostic Rating Scales appear to 
warrant the manipulation of any of 
the single subscores, so only the total 
prognostic score was used here. 

Thus, two predictive scores were 
employed: full-scale IQ (referred to 
as IQ), and the total ego-strength or 
prognostic score derived from the 
Prognostic Rating Scale (referred to 
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as PRS). These two criteria were 
shown to be relatively independent 
ir = .). 

Three achievement scores were 
employed: academic grade (AG), 
which was an average of all classroom 
examinations; ward grade (WG), 
which was an average of the ratings 
assigned to each student by the ward 
supervisors; and total nurse grade 
(TNG), which was simply the sum 
of the first two, as it was felt by the 
nursing staff that academic and ward 
work are of equal importance and 
neither should be weighted in an 
overall assessment of a_ student’s 
capabilities. 

The supervisors’ ratings, from 
which the ward grades were derived, 
were based on four criteria: 

1. Dependability (Does the student 
attend to her duties conscientiously? 
Is she always on time? Can one feel 
sure she will do a job without being 
asked twice?) 

2. Care of Patient (Does she ad- 
minister her duties quickly and ef- 
ficiently, without causing undue frus- 
tration or concern to the patient? Is 
her attitude to patients pleasant and 
sympathetic? Is she relaxed and cheer- 
ful in dealing with them? Does she 
do her work accurately?) 

3. Relationship with Superiors 
(Does she understand and _ follow 
orders easily? Does she manifest any 
resentment of authority?) 

4. Relationship with Peers (Does 
she work well in a team? Is she 
friendly, willing to go out of her way 
to help others? Is she popular with 
the other nurses on the ward?) 

All scores were expressed in stand- 
ard units, and eight product-moment 
coefficients were computed. Finally, 
one multiple correlation coefficient 
was computed, utilizing a combina- 
tion of IQ and PRS to predict TNG. 


RESULTS 


The range of IQ’s extends from 96 
to 133. Mean IQ is 113. Standard 
deviation is 8.23. The range of PRS 


is from 0.2 to 11.7. Mean PRS is 6.25. 
Standard deviation is 2.58. 


The correlations run as follows: 
IQ and PRS — .097 (not significant) 
AG and WG = .439 (significant at 

the 1% level of confidence) 

IQ and AG = .434 (significant at the 

1% level 
1O and WG = —.037 (not significant) 
1Q and TNG = .457 (significant at 

the 1% level) 

PRS and AG — .281 (significant at 
the 5% level) 

PRS and WG = .142 (not significant) 

PRS and TNG = .412 (significant at 
the 1% level) 

Miltiple correlation utilizing 1Q and 

PRS to predict TNG yields a coef- 

ficient of .586 = .59, which is signifi- 

cant at the 1% level of confidence. 


DISCUSSION 


From these results it seems clear 
that, at least in the somewhat re- 
stricted area of nurses’ training in a 
Canadian Catholic hospital, both in- 
telligence as measured by the Wechs- 
les-Bellevue and ego-strength as esti- 
mated by the Rorschach Prognostic 
Rating Scale are significantly related 
to overall achievement. There ap- 
pears to be no a priori reason why 
the same would not be true in other, 
non-Catholic, Canadian or American 
hospitals. 

These findings are of interest par- 
ticularly because assessment for apti- 
tude in fields like nursing has tra- 
ditionally been approached through 
the use of interest, aptitude, and vo- 
cational tests, rather than the em- 
ployment of more basic, general tools 
like the Wechsler and Rorschach. It 
seems to the author that whereas the 
former tests afford an appraisal of 
certain discrete surface characteristics 
of personality, the latter, in compari- 
son, reveal something of the more 
generalized emotional and_intellect- 
ual substratum. If that is the case, 
then it is here demonstrated that the 
strength or development of this sub- 
stratum manifestly influences one’s 
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capability even in so defined an en- 
deavor as learning to become a nurse. 

It is indicated, in any case, that 
wider use could be made of conven- 
tionally clinical tools like the Ror- 
schach and Wechsler in the field of 
vocational assessment. 

If we examine the findings in de- 
tail, we may note that both IQ and 
PRS correlate better with Total 
Nurse Grade than with Academic or 
Ward Grade alone. As a matter of 
fact, neither of our test measures can 
predict Ward Grade at all better 
than chance. One may ask whether 
this is occasioned by the fact that 
Ward Grade was based on the super- 
visors’ subjective ratings, which may 
well have been influenced by person- 
al likes and dislikes. However, one 
cannot give too much weight to this 
supposition, since an inner consist- 
ency of performance is shown in the 
fact of a significant correlation be- 
tween Academic and Ward Grades 
themselves. 

In all, IQ and PRS appear to be of 
equal value in predicting overall 
nursing ability, though IQ shows 
some superiority in predicting aca- 
demic ability alone. A combination 
of IQ and PRS appears to offer a 
better basis for prediction than either 
of these measures used singly. 

Of ancillary interest is the fact 
that no consistent test pattern was 
found in the records of those 12 girls 
who dropped out of training. Nor 
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were their reasons for leaving uni- 
form; they ranged from virtual ex- 
pulsion for unmannerly behavior, to 
family problems, to need for psychi- 
atric treatment. 


It may also be noted that the bar- 
ren quality of the case history materi- 
al seemed to the workers involved to 
be based on several factors. The girls 
may have felt that admission of any 
problems would prejudice their 
chances of being accepted for train- 
ing; they were also of an age- and 
social-group where the pursuit of 
‘good times’ is more central than 
dwelling on personal failings; and it 
must be recognized that  upper- 
middle-class Catholic upbringing does 
not encourage one to express dissat- 
isfaction or friction related to one’s 
family. 


_ SUMMARY 


A study was carried out using the 
Wechsler-Bellevue and Rorschach 
tests to predict success in nurses’ 
training. From the results it appears 
that intelligence as measured by the 
Wechsler and ego-strength as esti- 
mated by the Rorschach Prognostic 
Rating Scale are significantly related 
to achievement in nurses’ training. 
It would seem advisable for tests such 
as these to be employed more widely 
in the fields of vocational assessment 
and selection. 


Received August 24, 1956 





An Investigation of the Rorschach White Space Response 
in an Extratensive Experience Balance as a Measure 
of Outwardly Directed Opposition’ 


Davip C. MuRRAY 
Gulfport Division, Veterans Administration Center, Biloxi, Mississippi 


INTRODUCTION 

Rorschach (28) in his original pub- 
lication on his Ink Blot Test sug- 
gested that the presence of a white 
space response (S) always indicated 
some sort of oppositional trend. 
When § is found in conjunction with 
an extratensive experience balance 
(extratensive E.B.), Rorschach said 
the opposition would take “the form 
of some ‘outward’ opposition, defi- 
ance, a tendency to indulge in pol- 
emics, to make contradictions and to 
be aggressively stubborn” (28, p. 
200). Most Rorschach experts are in 
substantial agreement (6, 7, 9, 10, 17, 
20, 24, 25, 26). Lacking any "universal. 
ly accepted definition of “opposi- 
tion,” it will arbitrarily be assigned 
the following definition for the pur- 
poses of this study. Opposition is a 
tendency to resist, oppose, defy, rebel 
against, contradict, or in any way re- 
fuse to comply with environmentally 
produced suggestions up to and in- 
cluding the most extreme form of 
carrying out the opposite of what is 
suggested. 

It may be noted that as here de- 
fined, opposition appears to be on a 
continuum with the trait of positive 
suggestibility, so that one is the re- 
verse of the other, and between them 
is a state which might be called either 
nonsuggestibility or nonopposition. 


Previous studies of the white space 
response. Most earlier studies of S 


1A modification of a portion of a thesis sub- 

mitted to the Department of Psychology of 
Northwestern University in partial fulfill- 
ment of the requirements for the Ph.D. de- 
gree. The writer is indebted to Professor 
Robert Watson under whose direction the 
research was undertaken, and to other 
members of the faculty who were very gen- 
erous with their help. 


used markedly weak criterion meas- 
ures such as diagnostic categories (8, 
16, 30). Most recent information 
about S has been a by-product of 
studies whose primary purpose was 
something quite different (11, 21, 22, 
23). Several factor analytic studies of 
the Rorschach have included § (1, 32, 
33), but results are unclear. 

But four studies have been con- 
cerned solely or primarily with S 
(3, 15, 19, 29), and have attempted 
to use something other than diagnos- 
tic categories as the validating cri- 
terion. 

The present study is considered a 
methodological improvement on any 
one of these four, insofar as each of 
them failed to do one or more of the 
following: 1. Use the individually 
administered Rorschach rather than 
one of the group administered ver- 
sions. 2. Use adequate, representative 
behavioral criteria rather than paper 
and pencil type personality question. 
aires or rating scales alone. 3. Relate 
S to a relatively sharply defined per- 
sonality trait (oppositional tenden- 
cies directed towards the environ- 
ment) rather than to the more 
general trait of hostility. 4. Take ac- 
count of the patterns of Rorschach 
scores by considering S in relation to 
but one type of E.B., rather than 
lumping all S responses together in- 
discriminately. 5. Control the res- 
ponse total (R) on the Rorschach 
Test since significant relationships 
have been reported between R and S, 
M, FC and CF (14, 15, 27). 6, Use 
standard procedures in administering 
the Rorschach. 

The specific purpose of this study 
is to investigate the validity of the 
presently widespread interpretation 
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of S in an extratensive E.B. as indi- 
cating outwardly directed opposition. 


PROCEDURE 


The criterion measures. There is 
evidence that neither oppositional 
tendencies, nor suggestibility, are 
unitary traits (2, 13). Rorschach in- 
terpreters provide no clear operation- 
al definition of what they mean by 
“opposition.” Therefore an attempt 
was made to select criterion measures 
which would serve as a fair sample 
of the many theoretically possible 
types of opposition. Six criteria were 
chosen which seemed to be related 
to six apparently different aspects of 
oppositional behavior. 

1. Hull Sway Test (13, 18). The 
subject stands with feet together and 
eyes shut, while the researcher's re- 
corded voice repeatedly tells him he 
is swaying forward. In a second form 
the voice tells him he is swaying back- 
wards. A score was derived from each 
form. The test appears to measure 
the degree to which a person uncon- 
sciously accepts, resists, or does the 
opposite of a motor movement, fol- 
lowing the repeated suggestion that 
such a movement will take place. 

2. Ink Blot Suggestion Test (13). 
The subject is shown each card of the 
Rorschach. Two frequently seen and 
two poor, infrequently seen percepts 
on each card are suggested to him 
with the comment that many people 
see them. Four scores are derived for 
this test. The negativism score meas- 
ures the refusals of the subject to see 
the frequently seen percepts. The 
non-negativism score measures refus- 
als of the subject to be swayed either 
against the frequently seen, or to- 
wards the infrequently seen, percepts. 
The suggestibility score measures the 
acceptance by the subject of the in- 
frequently seen percepts, The total 
score is a weighted addition of the 
other three. This test appears to 
measure the extent to which sugges- 
tions cause a subject to report per- 
cepts for which there is no objective 
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basis and to refuse to report percepts 
for which there is an objective basis. 

3. Opinion Questionnaire (4). The 
subjects indicated agreement or dis- 
agreement with a series of opinion 
items, as well as how sure they were 
of their opinion, When given the 
questionnaire a second time, twelve 
days later, they were allowed to know 
the group’s opinion before answering 
each item. Three scores were derived 
from this questionnaire. The nega- 
tivism score measured changes away 
from the group opinion. The sugges- 
tibility score measured changes in the 
direction of group opinion. The total 
score was the difference between the 
other two scores. This questionnaire 
seems to measure a change of attitude 
by the subject on learning the atti- 
tude of the majority of his compeers. 

4. “No” answers on the Opinion 
Questionnaire. This score indicated 
the number of times the subject chose 
the “No” answer on the first adminis- 
tration of the Opinion Questionnaire. 
It seems to measure a general res- 
ponse tendency on the part of the 
subject to give negative rather than 
positive replies to questions, regard- 
less of the content of the question. 

5. Instructions Test. As a prelim- 
inary to some of the other tests the 
subject was asked to give certain basic 
information concerning himself in 
certain specific ways, as by circling, 
checking, underlining, etc. The score 
was the number of times the subject 
followed instructions exactly. This 
appears to measure the extent of a 
subject’s natural, uncoerced obedi- 
ence to directions. 

6. Self-rating scale. The subject 
rated himself as to oppositional be- 
havior, suggestibility, and aggressiv- 
ity, as well as on seven other traits 
which served as misleads. For each 
trait the rating consisted of choosing 
the one’ out of seven statements 
which he thought most nearly ap- 
plied to himself. Three scores were 
derived, one for each of the three 
traits. 
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TABLE I. Reliability of the Criterion Measures 


Criterion Measure 

Ink Blot Suggestion Test 
Negativism score 
Non-negativism score 
Suggestibility score 
Total score 

Hull Sway Test 
Forward vs. backward 
Forward: first 50 vs. 

last 50 seconds 

Opinion Questionnaire 
Negativism score 
Suggestibility score 
Total score 

Instructions Test 

“No” answers 


Split-half 
Split-half 
Split-half 
Split-half 


Alternate form 


Split-half 


Odd-even 
Odd-even 
Odd-even 


‘Test-retest 
Odd-even 


Type Reliability 


Coefficient Spearman-Brown 
608 .756 
311 A74 
123 839 
159 863 
701 
789 918 
506 672 
57 627 
508 674 
SAG 706 
4 jo 431 


TABLE II. Intercorrelations of the Criterion Measurest 


Criterion Measures 


Criterion Instruct. Blot Total 
Measures 
Opin. Total —.049 .244* 
Instructions —.048 


Blot Total 

“No” Answers 

Sway Forward 

* Significant at .05 level. 
** Significant at .01 level. 


“No” Answer Sway Forward Neg. Rating 


—.056 .099 —.064 
—.098 —.094 .000 
468* * 075 020 
114 —.071 

—.297** 


$ Total score on the Opinion Questionnaire and forward sway score on the Hull Sway Test 
were reversed so that high score indicates negativism and low score suggestibility for all 


of the criterion measures. 


Lacking a second administration 
of the rating scales, no measure of 
their reliability is available. Relia- 
bilities of the other criteria are given 
in Table I. 


Correlations between the total 
scores for all criterion measures were 
computed. Results are given in Table 
II. 


Rorschach administration and scor- 
ing. The Rorschach was administered 
and scored in the manner described 
by Beck (5, 6, 7). Spot checks on the 
author’s scoring of three of the Ror- 
schach records by 12 independent 
scorers indicated an average agree- 
ment of 89 percent between the pres- 
ent author and the independent 
scorers. 

Administration of the tests. All sub 
jects were drawn from a Northwest- 
ern University child psychology class 





of 258 students. The Opinion Ques- 
tionnaire and the Instructions Test, 
which could be group administered, 
were given twice, with a twelve day 
interval between presentations, to all 
class members, On the second presen- 
tation the Opinion Questionnaire 
showed the majority opinion of the 
class. A total of 204 students were 
present at both sessions. From this 
pool of potential subjects 101 student 
volunteers were drawn for the indi- 
vidually administered tests. The aver- 
age age of the 24 males was 20.3 years, 
and that of the 77 females was 19.7. 
When the subject arrived for indi- 
vidual testing the author established 
rapport and then administered the 
Rorschach, gave the subject the two 
sections of the Hull Sway Test, had 
the subject fill out the self-rating 
scale, and finished with the Ink-Blot 
Suggestion Test. 
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STATISTICAL TREATMENT 


Analysis of variance was used since 
it showed whether any relationship 
found was due to S, E.B., or their 
interaction, Male and female sub- 
jects were found to differ significantly 
in their production of S, so it was 
necessary to control the sex of the 
subjects in the analyses of variance. 
Beck (7) now feels that percent of S 
is more meaningful than total num- 
ber of S. He suggested to the author 
that nine percent or more S be con- 
sidered as indicating a significant de- 
gree of oppositional tendencies. Sub- 
jects were divided into two groups, 
those having nine percent or more 
S and those having no S. Subjects 
having between one percent and 8.9 
percent S were not used, 

The two groups, those with no S 
and those with nine percent or more 
S, were divided into three parts on 
the basis of the E.B. An extratensive 
E.B. was defined as a ratio of sum C 
to sum C plus M of .60 or more, an 
introversive E.B. as a ratio of .40 or 
less, and an ambiequal E.B. as a 
ratio between .40 and .60. The six 
groups will be referred to respect- 
ively as SI (S and introversive E.B.) 
SE (S and extratensive E.B.) SA (S 
and ambiequal E.B.), OI (No S and 
introversive E.B.), OE (No S and 
extratensive E.B.), and OA (No S 
and ambiequal E.B.). 
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An attempt was made to control, 
at least partially, the Rorschach res- 
ponse totals of the subjects used in 
the analysis of variance. This was 
possible when there were more sub- 
jects than were needed in one of the 
groups. Subjects to be used in the 
analysis of variance were then chosen 
by selecting those subjects who had 
an R which would bring the average 
R of their group closest to that of 
the other groups. 

RESULTS AND Discussion 

There was homogenity of variance 
among the groups being analyzed 
(12). An attempt was made to con- 
trol R very closely (the four average 
R’s were 25.5, 24.0, 24.4 and 27.9) 
by using only seven subjects, all fe- 
males, in a group and omitting the 
SA and OA groups from the analyses. 
This series of variance analyses will 
be referred to as the “first series.” 
For results see Table III. The one 
significant result could easily have 
been due to chance. 

A similar attempt to control R 
very closely (the four average R’s 
were 20.7, 25.3, 27.0 and 24.0) was 
made by using only seven subjects, 
six females and one male, in each 
group, and omitting the SI and OI 
groups from the analyses. This series 
of variance analyses will be referred 
to as the “second series.” For results 


TaB_e III. Results of Analyses of Variancet 


Series Source “No” Instruc- 
Answers tions 
First EB 4.98* # 
Series S # # 
Sx EB 2.99 # 
Second EB # # 
Series S # # 
Sx EB 4.95* 7.05* 
Third EB - # 
Series S # # 
Sx EB 4.95* 1.47 


(Quotients 
of F Ratios) 
Criterion Measures 


Blot Blot Blot Blot 
Total Neg. Nonsug. Suggest. 
# = # = 
# = # # 
# # # = 
# # # 1.35 
# # # 1.08 
1.27 1.18 # 1.12 
# 1.53 # 1.03 
# # = # 
372° 2.93 # 3.36* 


$ Results of Hull Sway Test, Self Ratings, and Opinion Questionnaire, are not given since 
all results were short of the .05 level of significance. 

* Significant at the .05 level. 

# The error estimate is larger than the mean square being compared with it. 
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see Table III. There is about one 
chance in four the two significant F 
ratios are both due to chance. 

Since the small number of subjects 
might have been responsible for the 
essentially negative results, a “third 
series” of variance analyses was cal- 
culated using all six groups (SE, SA, 
SI, OE, OA, OI). Only females could 
be used as there were no males in 
the OA group. 

To maximize degrees of freedom 
the number of subjects per group 
was placed at the size of the group 
with the smallest number of women, 
thus putting eight subjects in each 
group. Although subjects were chos- 
en for each group in such a way as to 
keep R as similar as possible from 
group to group, the average R’s for 
the groups were rather discrepant 
(30.6, 22.1, 20.7, 21.6, 37.5 and 20.1). 
The only significant F tests, at the 
.05 level, were for “No” answers on 
the Opinion Questionnaire and _ for 
both the total and suggestibility 
scores on the Ink Blot Test and they 
were significant only for interaction. 
(See Table III.) 

For each of these three scores two 
separate analyses were done, one for 
the three E.B. groups with nine per- 
cent or more S and one for the three 
groups with no S. When a significant 
between groups variance was found 
the individual groups involved were 
compared by means of “t” tests. In 
all three cases, for each E.B., a “‘t’”’ test 
was used to compare the group with 





051 2.4 











** Significant at .01 level. 
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nine percent or more S and that with 
no S. 

In all cases, as can be seen in Table 
IV, the F tests for the three groups 
with nine percent or more S (SE, 
SA, SI) were significant at the .01 
level and those for the three groups 
with no S (OE, OA, AI) did not 
reach significance. Among those with 
nine percent or more S, the SA group 
was most oppositional in all three 
cases. The SI group was the least op- 
positional as measured by both the 
total score and the _ suggestibility 
score of the Ink Blot Suggestion Test, 
while the SE group was the least op- 
positional as measured by the “No” 
answers. Results of comparisons be- 
tween pairs of groups are also given 
in Table IV. 

To determine whether results in 
the last series of variance analyses 
were due to variations in R, an an- 
alysis of variance was done for R, 
with E.B. and S as the two factors. 
The F’s for E.B. and for interaction 
were not significant, that for S was 
significant at the .05 level. Since R 
is not significantly related to the 
interaction between E.B. and §, it 
appears unlikely that R was respon- 
sible for the significant F’s for inter- 
action on the “No” answers and the 
two scores of the Ink Blot Suggestion 
Test. Average R of those with nine 
percent or more S was 29.6, for those 
with OS, 21.3. This is probably an 
artifact since there is a better chance 
of not finding any S in a short record 


Tasce IV. Breakdown of Significant Results on Third Series 
Analyses of Variance 
(Average scores for each group, with accompanying F and t tests.) 


Criterion Exp. Bal. An. of Var, t 
Ext. Amb. Int. F Ex A ExI xd 
“No” S 25.1 32.1 50.6 6.168** 3.41** 268* 0.73 
Ans. Os 28.0 27.2 29.1 0.423 
t 1.10 2.38* 0.73 
Blot S 17.0 19.5 39.1 5.937** 0.80 2.51¢ 3.30** 
Potal OS 18.6 15.1 16.9 0.746 


7 





Blot Ss 3.2 2.4 74 6.367** 0.58 2.74* 3.389¢ 
Sug. Os 2.6 1.1 3.6 0.517 
t O41 1.16 2.49* 
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than in a long record, and the pres- 
ence of even one S, no matter how 
long the record, removes the record 
from the no S group. There remained 
a possibility that oppositional sub- 
jects might give fewer R, but more 
S. Then the fact that the subjects 
with no § had fewer R, and those 
with nine percent or more S had 
more R might be cancelling out sig- 
nificant differences between the OS 
and the nine percent S subjects. To 
test this, analyses of variance, using 
three factors with EB, S, and R as 
the three factors, were performed on 
the “No” answers, and the two Ink 
Blot Suggestion Test scores. High R 
ranged from 23-51, low R from 16-19. 
Average R for the high R group was 
30.0 for the low R group 17.3. It was 
possible to use only 24 subjects, 
which weakens the analyses, but re- 
sults are still suggestive. For “No” 
answers, only R was significant at the 
five percent level. For the two Ink 
Blot Suggestion Test scores there 
were no significant scores. For all 
three analyses S was highly nonsig- 
nificant. R may be related to negativ- 
ism, at least as shown by the “No” 
answers (the more “No” answers the 
fewer the R) but S is certainly not. 


Results seem to imply that, for the 
population sample studied and the 
measure of oppositional tendencies 
used, a combination of an extratens- 
ive E.B. and the use of § is not in- 
dicative of oppositional tendencies. 


White space, by itself, does not ap- 
pear related to any of the samples of 
oppositional tendencies used in this 
study. This finding agrees with that 
of Fonda (15) on the group Ror- 
schach, and is not inconsistent with 
the findings of Ingram (19). Ingram 
did find a low, but significant, cor- 
relation between S and people rated 
as aggressive in an interactive situa- 
tion, but the relationship between op- 
position and aggressiveness is not 
clear cut. The findings of the present 
study, as they concern S, are in dis- 
agreement with the findings of Ban- 
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dura (3), who found a low but sig- 
nificant relationship between high 
school teachers’ ratings of negativism 
and use of white space by their pu- 
pils. However, in addition to using a 
different system of scoring for S, and 
using sum S$ rather than percent S, 
a nonstandard form of Rorschach ad- 
ministration was used. 


Chance factors probably account 
for the one instance where E.B. ap- 
pears related to a sample of opposi- 
tional behavior, a finding in agree- 
ment with Fonda (15) and Bandura 
(3). 

To some extent oppositional ten- 
dencies are related to the interaction 
between S and E.B. on two of the 
criterion measures, This finding is 
in disagreement with Bandura’s con- 
clusion (3) that E.B. did not effect 
the relationship between S and five 
behavior ratings, including negativ- 
ism. 


SUMMARY AND CONCLUSIONS 


Six assumed measures of opposi- 
tional tendencies were given to 101 
college students of both sexes, along 
with the individually administered 
Rorschach. The criterion measures 
were hypothesized to measure a var- 
iety of different types of opposition. 
Subjects were divided into separate 
groups on the basis of S percent and 
E.B. All groups were equalized in 
numbers, subjects being eliminated 
from groups when necessary on the 
basis of discrepant R on the Ror- 
schach. Separate analyses of variance 
were done with S percent as one fac- 
tor and E.B. as a second factor for 
each assumed measure of opposition. 
From one to four separate scores were 
subjected to analysis of variance for 
each criterion measure. 

The following conclusions appear 
warranted: 1. S responses and out- 
wardly directed oppositional tenden- 
cies, as measured by the six criterion 
measures used, are not related for 
the population sample tested. 2. 
Extratensive E.B. and outwardly di- 
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rected oppositional tendencies, as 
measured by the six criterion meas- 
ures used, are not related for the 
population tested. 3. The use of S 
in an extratensive E.B. is not indica- 
tive of outwardly directed opposition- 
al tendencies, as these are measured 
by six criterion measures, with the 
population tested. 4. Interaction be- 
tween S and E.B. does appear related 
in two of the measures. The nature 
of this relationship varies differen- 
tially, both in relation to S and to 
E.B. The relationships were small, 
and do not warrent use in individual 
interpretations of Rorschach records. 
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White Space on the Rorschach: Interpretation and Validity' 


Davip C, Murray 
Gulfport Division, Veterans Administration Center, Biloxi, Mississippi 


The white space (S) response was 
established as an important Ror- 
schach variable in Rorschach’s orig- 
inal experiment (33). Since that time 
many studies have touched on it. Re- 
cently several studies have made de- 
termined efforts to validate certain 
interpretations. All have suffered 
from failure to consider the great 
variety of interpretations which have 
been suggested, particularly those 
taking into account not only S but 
also one or more other responses. 
This review proposes to classify and 
enumerate the many varying inter- 
pretations of S, and to briefly con- 
sider studies which bear upon their 
validity. 

Interpretation of S. Many inter- 
pretations have dealt with S per se, 
regardless either of other Rorschach 
factors or of the type of individual 
concerned, A large number of inter- 
pretations are concerned with differ- 
ent types of S. Often interpretations 
have considered the meaning of S 
when found in conjunction with oth- 
er Rorschach scores. Finally many in- 
terpretations have been dependent 
upon the individual’s diagnosis. 

Interpretations of S per se will be 
considered first. The most popular is 
that it represents some form of op- 
position (3, 5, 17, 19, 21, 22, 28, 32, 
33). A related concept is that it in- 
dicates some such quality as persist- 
ence, determination, stubbornness or 
obstinacy (3, 4, 6, 28, 31, 33). 

It has been said to indicate flex- 
ibility and elasticity (8), a tendency 
to do different and unusual things 


"This article is a condensation and modern- 
ization of an appendix to a dissertation sub- 
mitted to the graduate school, Northwestern 
University, in partial fulfillment of the re- 
quirements for the degree of doctor of 
philosophy. 


when confronted with a situation 
(17, 19, 23) or an infantile adapta- 
bility of vision (28). Piotrowski (31) 
suggests it may bespeak both change- 
ability and decisiveness. The person 
with many S responses displays a 
feeling of self-confidence in his own 
strength and individuality, and makes 
his frequently incompatible resolu- 
tions with a feeling of certitude. 
Klopfer et al (21) relate the ability 
to use S to ego strength, saying it im- 
plies the ability to resist being over- 
whelmed by forces in the environ- 
ment or by motivational confusion. 

S has also been said to indicate op- 
portunism (28), fluency (1), and in 
some cases an indication of certain 
cultural or sub-cultural factors (12). 
One author (29) feels that lack of S 
indicates passivity, suggesting he may 
view its presence as indicative of ac- 
tivity. Loosli-Usteri, as quoted by 
Kelley and Rieti (19) suggests the 
subject may be defending himself 
against repetition of interpretations, 
or that the subject does not want to 
interpret the black. 

S in which there is a complete re- 
versal of figure and ground is felt by 
Bochner and Halpern (8) to repre- 
sent an oppositional quality because 
it is a reversal and because of its 
solidity. Phillips and Smith (30) 
speak of stubbornness, resistiveness, 
independence of thought, and _ idea- 
tional characters. When there is very 
much of this type of S, particularly 
in main locations, balanced percep- 
tion of reality is hypothesized to suf- 
fer due to the emphasis on competi- 
tive and stubborn self-assertion, and 
on doing things differently (21). This 
type of S, and responses using only 
the edges of a white area, are said to 
be usually indicative of compulsive 
reactions or inhibitory ambivalences 


(22). 
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In percepts in which the lack of 
solidity of the blot is stressed, as in 
a butterfly with holes in it,” the S 
is thought to indicate the individu- 
al’s feelings of insufficiency and in- 
security (8, 35) or disrupted personal 
relations, and a feeling others are not 
to be trusted (30). 

The “cave form” S where a dark 
figure encircles an S, as on card II, 
is said by Schachtel (35) to reveal a 
“need for shelter” or “fear of enclo- 
sure,’ depending on whether the en- 
circling figure is seen as fortifying 
and defending or as oppressive and 
imprisoning. He feels that when this 
type of S response has a vista quality 
it seems based on a feeling of inse- 
curity and instability. S with vista is 
seen as indicating introspective tend- 
encies when found in moderate de- 
gree, and self-consciousness based on 
negative attitudes towards the self 
when overemphasized (22). 

S used additionally in a_ percept 
which is primarily a response to the 
blot is believed to indicate elasticity 
in the subject’s mind, and the occa- 
sional ability to look at problems 
from an unusual angle (23). The tiny 
S is said to produce evidence of grum- 
bling, spitefulness and petty rebel- 
liousness (16). 

When used primarily for its color 
value, its whiteness, S has been inter- 
preted as representing an unconven- 
tional tendency if bright colors are 
also used, but a traumatic experience 
with resentment if they are not (22). 
A different interpretation is that it 
indicates intermittent conscious non- 
depressive moods and a fighting spirit 
which helps uncover usually over- 
looked aspects of reality (31). One 
pair of experts feel it reveals apathy 
and inability to act decisively if S$ is 
used as color and the percept is form- 
less or of indeterminant form (30). 

Phillips and Smith (30) indicate 
that when §S is undifferentiated from 
the remainder of the blot, as in a 
“black and white butterfly” this is an 
index of pathology in adults, and is 


associated with profound dullness 
and apathy. Deteriorated  schizo- 
phrenia or occasionally an organic 
lesion is suggested. 

When the S percept comes first it 
is said to characterize the natural ap- 
proach of the subject, but if it is 
among the last responses on the card 
the subject is using every available 
stimulus for interpretation, display- 
ing his thoroughness and ability (8). 


Many authors interpret S differen- 
tially depending on the experience 
balance. When found in an ambi- 
equal experience balance it is said to 
bespeak skepticism, doubt, hesitancy, 
vacillation and indecision as well as 
emotional ambivalence and ambi- 
tendencies (4, 16, 31, 33). A vacilla- 
tion between outward and inward ag- 
gression, resulting in skepticism and 
in extreme cases nihilism, is hypothe- 
sized (8). 

When S is found with an extraten- 
sive experience balance, almost all 
authors indicate that opposition is 
directed outwards alin: 4 the en- 
vironment (4, 8, 9, 16, 23, 29, 31, 32, 
33). 

Variations on the theme of self 
directed opposition are suggested by 
S in conjunction with an introversive 
experience balance. Rorschach (33) 
spoke of opposition to the subject's 
own inner life, resulting in constant 
self distrust, feelings of insufficiency 
of every sort, self-criticism and cir- 
cumstantiality. Others speak of oppo- 
sitional tendencies directed towards 
the subject’s own self and thinking 
(32), arguing with the self (31), in- 
ternal resistance, a feeling of inferi- 
ority (9), autocriticism and self-doubt 
stemming from the self-aimed hostil- 
ity and aggression of the individual 
(8), and overt self-will, along with 
opposition to one’s own deep wishes 
(3). Gurvitz (16) feels that S in an 
introversive experience balance will 
probably result in intellectualized ag- 
gression such as sarcasm or caustic 
wit. 

When §S details are evenly distrib- 
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uted along with other types of small 
details it is said to indicate either rich 
artistic responsiveness or an intuitive 
sense for the unusual (23). Many rare 
details along with main S are thought 
to indicate doubt and opposition di- 
rected toward one’s own thinking 
(32). 

Lindner (24) states that white, 
when used in the chromatic cards, 
throws suspicion on the subject’s psy- 
chological integrity, and that when 
only the white spaces are used on the 
colored cards a serious mental dis- 
turbance is indicated. Lindner lists 
specific responses for five given S 
areas and gives diagnostic interpret- 
ations for each response. 

Some authors give interpretations 
specifically for certain diagnostic 
categories. Thus normal individuals 
who are very compliant and eager to 
be accepted indicate concealed oppo- 
sition and independence by produc- 
ing many S (10). Small quantities of 
S are said to show driving stubborn- 
ness, while in larger quantities it 
shows arbitrary, aggressive souls (16). 
In healthy, intelligent individuals it 
indicates a resolution and _ persever- 
ence that achieves a well understood 
objective despite obstacles and dis- 
appointments, while in the less in- 
telligent, partially educated individu- 
al it reveals contumacy and obstinacy 
that may result in destructive narrow- 
mindedness (3). Poor endowment is 
felt to preclude the occurrence of S 
(32). 

In patients S may indicate a po- 


tential stormy therapeutic course 
with active negative transference 
(16). 


Beck says S is consistently absent 
in depressed people, indicating their 
resignation to their troubles, while 
in the feebleminded it suggests man- 
agement difficulties (3). 

In paranoids § is said to bespeak 
a vexingly unbending rigidity in 
Sticking to twisted ideas (3, 4), or 
rigidity plus the tendency of the pa- 
tient. to actively force his view of 
reality upon the world (16). 


49 


It is low or absent in passive indi- 
viduals, according to Beck, and in 
psychopathic personalities it issues di- 
rectly in destructive behavior against 
society and may eventuate in delin- 
quency (3). In schizophrenics S is said 
to indicate negativism (3, 16, 33), as 
well as blocking and _ eccentricity 
(33). 

Studies of the validity of the white 
Space response. Some studies indicate 
differences in S_ between clinical 
groups. Buhler et al (10) found that 
the groups giving the least S were 
nonpsychotic organics, social psycho- 
paths and depressed neurotics, while 
normals gave by far the most S. In 
a later study (11) nonpsychotic or- 
ganics, nonparanoid schizophrenics, 
depressed, and paranoid schizophre- 
nics had the least S, while normals 
and sexual psychopaths had the most. 
This finding might be felt to con- 
traindicate S as showing opposition 
since paranoids and _ schizophrenics 
are usually thought to be more oppo- 
sitional than normals. However, the 
differences may be explainable in 
terms of uncontrolled differences in 
response totals (R), since § does vary 
with R. 


In a study by Klebanoff (20) 26 
male paretics had significantly more 
S than did normal males matched for 
age and education. Again R was un- 
controlled. No interpretation was 
offered. Rapaport (32) found overid- 
eational preschizophrenics to have 
significantly more S than neurotics 
and normals and combined paranoid 
and unclassified schizophrenics. Since 
overideational schizophrenics average 
50 R per record, while no other group 
averaged over 30 R, the differences in 
S are probably a function of the dif- 
ferences in R, 


Billig and Sullivan (7) report that 
the poorer the prognosis, based on 
past performance, of alcoholics, the 
more S they produced, and suggested 
the S indicated aggressivity, and ag- 
gressive alcoholics were harder to 
cure, 
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Goldfarb (15) found twenty ado- 
lescents diagnosed obsessional had 
significantly more S in their records 
than twenty unselected adolescents. 
The excess of S percepts by the ob- 
sessionals may have been a function 
of their need to uncover all possible 
responses, and of their higher R. 


Suares (36) concluded that ado- 
lescent girls saw more S than ado- 
lescent boys, but felt this probably 
did not indicate opposition in her 
girls since one-third of the boys were 
clinic boys known to be in strong re- 
volt against their milieu. Again un- 
controlled R may have been a factor. 

In a pre- and post-therapy study, 
utilizing only main S, Lipton (26) 
found a decrease of S after insulin 
coma treatment in seventeen schizo- 
phrenic patients. Although S was cut 
in half after therapy this may have 
been due to the reduction in produc- 
tivity which also took place. The 
total number of S was very small to 
begin with. 

Counts and Mensh (13) admin- 
istered the Rorschach to eight sub- 
jects under normal conditions, and 
then again after the subject had been 
hypnotized and given suggestions to 
produce an artificial conflict, a third 
time after rehypnotization and_ re- 
moval of the conflict, and a final time 
by a different examiner under normal 
conditions. The mean per cent of S 
increased by fifty per cent from the 
first to second administration but re- 
mained unchanged thereafter, which 
was interpreted as indicating that the 
change in hostility level noted in psy- 
chiatric interview material was not 
reflected in the S response. 

Three factor analytic studies con- 
tribute something to our knowledge 
of S responses. Adcock (1) studied 
88 Cook Island and 30 New Zealand 
children, and found § to fit into a 
factor with low P per cent, low A per 
cent, low W and high R. He felt this 
to be a fluency factor. 

In a study of 92 Yale undergradu- 
ates by Wittenborn (37) S was shown 


to correlate .61 with a factor high in 
D, d, Dd, M, FM, F, Fc, C’, FC, and 
O. He felt this factor indicated pro- 
ductivity. In a second study (38) of 
160 out-patients and in-patients of a 
psychiatric hospital there was a fac- 
tor comprised primarily of S and or- 
iginal responses. Such responses were 
said to be characteristic of seriously 
disturbed people, particularly when 
the form level of the responses was 
inferior or when content was im- 
plausible or confused. 


Two studies directed specifically 
at S utilize personality questionnaires 
as the criterion. Fonda (14) admin- 
istered the Guilford-Martin Person- 
nel Inventory, Inventory of Factors 
GAMIN, the standard group Ror- 
schach and Harrower’s parallel series 
to 150 college undergraduates. 


Using a standard S score which 
took R on the Rorschach into ac- 
count, he found a significant correla- 
tion between S and the “?’ score 
from the questionnaires for subjects 
with an extratensive experience bal- 
ance, for subjects with an introversive 
experience balance, and for all three 
experience balances combined. No 
significant correlations were found 
for the total group or for any of the 
three experience balances between 
standard S score and scores on factors 
meant to measure aggreeableness, co- 
operativeness and inferiority. No sig- 
nificant correlations were found be- 
tween S and “?” for subjects with an 
a experience balance. S$ in 
an ambiequal experience balance is 
supposed to indicate indecisiveness, 
and the use of the ‘?” choice on the 
questionnaires might be similarly in- 
terpreted. Therefore these results sug- 
gest S in an ambiequal experience 
balance may not be related to inde- 
cisiveness. Partial corroboration of 
Rorschach’s hypothesis is indicated 
however if excessive use of “?’’ is con- 
sidered indicative of contrariness. 
Generalization of results is unwar- 
ranted due to use of the group Ror- 
schach. 
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Rosen (34), using only main §S 
found no significant relationship be- 
tween S and MMPI scores on the 
paranoid, psychasthenic, . depressive 
and psychopathic deviate scales. By 
excluding 22 psychopathic subjects 
from his sample he did find a signifi- 
cant relationship between S and the 
psychopathic deviate scale. 

Linn (25) showed that more sol- 
diers rated superior had S$ than sol- 
diers rated above average, average or 
inferior, There is little evidence for 
Linn’s suggestion that this is because 
those who keep hostility covert be- 
come the best soldiers and the unex- 
pressed hostility comes out in S. 


In a study aimed at finding Ror- 
schach differences due to different 
methods of administration Lord 
(27) gave neutral, emotionally posi- 
tive and emotionally negative admin- 
istrations of the Rorschach to 36 col- 
lege students. Negative administra- 
tion yielded more S than neutral, in 
line with her hypothesis of increased 
negative behavior as the response to 
an emotionally negative administra- 
tion. The most S of all was found 
with emotionally positive adminis- 
tration, which is not in line with the 
hypothesis. Also R varied with ad- 
ministration in the same way § did. 
Perhaps increased R_ indicated in- 
creased rapport, and increased § re- 
flected increased R. 

Ingram (18) compared eight Negro 
college students producing two or 
more main S with eight who pro- 
duced none. All subjects were rated 
on behavior during a_ frustrating 
pyramid puzzle problem and an in- 
tensely frustrating interview. People 
high on S were concluded to be more 
aggressive in a participatory, inter- 
active way (interview situation) than 
people with low S. In the puzzle sit- 
uation, with social interaction mini- 
mized, there was no difference. R 
was uncontrolled. 


Bandura (2) gave the Rorschach 
to 81 high school students, and used 
teachers’ ratings of negativism, assert- 
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iveness, self-distrust and inadequacy 
feelings as the independent criteria 
of oppositional tendencies. Subjects 
were required to look at each card for 
four minutes, which may have differ- 
entially affected production of S from 
subject to subject. Thirty-two sub- 
jects with an extratensive experience 
balance and 28 subjects with an in- 
troversive experience balance were 
used in the final analysis. In no case 
was there a significant difference 
from one experience balance to the 
other. Since R and S were closely re- 
lated, partial correlations were used 
to find the relation of S to the per- 
sonality variables with R held con- 
stant. Partial correlations between S 
and assertiveness, inadequacy, and 
self distrust were all nonsignificant. 
A partial correlation of .27 (signifi- 
cant at the two per cent level) was 
found between S and negativism. 


A major criticism of all studies but 
the last is that R is not controlled, 
and may have been responsible for 
any findings. Several studies are hurt 
by their use of group Rorschach and 
nonstandard administrations of the 
Rorschach, since this greatly weak- 
ens any generalization of the Ror- 
schach as used in standard clinical 
practice. Questionnaires and rating 
scales are perhaps somewhat unre- 
liable and weak as criterion meas- 
ures. None of the studies yields re- 
sults which would indicate that S$ 
can be safely used in the interpreta- 
tion of the individual record. On the 
other hand the weaknesses indicated 
above suggest that none of the studies 
can be considered in any way defini- 
tive. There are relatively few studies, 
and they touch on a bare minimum 
of the many suggested interpretations 
of S. 


Summary: The many varied inter- 

retations of S have been reviewed 
both as they apply to S per se, and as 
they apply to different types of S, as 
they apply to different diagnostic 
categories, and as they relate to S in 
conjunction with other Rorschach 
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variables. Studies bearing on the val- 
idity of these interpretations have 
been reviewed, insofar as there are 
such studies. It was concluded that 
all present studies have weaknesses 
which prevent their being definitive, 
and that while no studies to date sug- 
gest that any of the interpretations 
are sufficiently valid insofar as the in- 
dividual Rorschach record is con- 
cerned, the weaknesses in present 
studies prevent this judgment from 
being final. Very few of the many sug- 
gested interpretations have yet been 
tested. 
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The Rorschach as an Index of Pathological Thinking * 


BENJAMIN POPE AND ARTHUR R. JENSEN 
Psychiatric Institute, University of Maryland 


The concept of pathological think- 
ing is used widely in the clinical 
evaluation of mental patients. Yet it 
is a poorly defined concept for it has 
a multitude of theoretical referrents 
and has largely evaded efforts at suc- 
cessful quantification. In this study 
the Rorschach is used as a basis for 
a theoretical formulation of path- 
ological thinking and as an index for 
its quantification. The Index was de- 
vised by Watkins and Stauffacher 
(15) and cross-validated by Powers 
and Hamlin (11). In the present study 
its reliability is re-examined and its 
validity investigated on the basis of 
criteria that are different from those 
used until now. 

Within the context of this study, 
and perhaps more generally too, path- 
ology of thought is assumed to come 
to its clearest focus in schizophrenia. 
Bleuler’s (3) discussion of the asso- 
ciative disturbance in schizophrenia 
is well known. According to him, 
social relevance and logic as determ- 
inants of thought associations give 
way to accidental contiguity, clang 
similarity, condensation, and stereo- 
typy. Also within the realm of asso- 
ciative disturbance are Cameron’s (9, 
pp. 50-64) formulations regarding 
asyndetic thinking and interpenetra- 
tion of themes. Other authors have 
stressed the schizophrenic’s loss of 
conceptual thinking, his concreteness. 
Thus Goldstein (9, pp. 17-40) sees the 
schizophrenic’s thinking as similar to 
that of the organic patient, with 
words becoming denotative rather 
than connotative. He also demon- 
strates an impairment of the capacity 
to sort objects into conceptual cate- 
gories. Both Kasanin (9, pp. 1-4) and 
Benjamin (9, pp. 65-90) have different 
operational approaches to the same 


* Thanks are due Dr. Lester M. Libo for help 
in developing the manual used in this study. 


problem, but their conclusions are 
similar to Goldstein’s. On the other 
hand, Von Domarus (9, pp. 104-114) 
and Arieti (1) stress the schizophren- 
ic’s modification of accepted logical 
thought. 

The psychoanalytic term, primary 
process, refers to many of the same 
formal thought characteristics found 
in schizophrenic thinking, such as 
condensation, displacement, and sym- 
bolization (4). However, it is given a 
more general significance than the 
concept of pathological thinking, for 
it manifests itself in the dream worlds 
of normals (4) and in such ubiquitous 
phenomena as slips of the tongue, 
humor, and the effects of fatigue. 
Rapaport (12) characterizes the pri- 
mary process as the drive organization 
of memories and thoughts, with the 
complete interchangeability of drive 
representations resulting in the phen- 
omena of condensation, displacement 
and symbolization. By contrast, the 
secondary process is guided by reality 
connections and the accepted laws of 
logic. The structural precondition for 
the secondary process is an ego with 
the capacity to delay the immediate, 
direct discharge of drives. Recently 
Holt (7) has emphasized the error 
in assuming that primary and second- 
ary processes constitute a dichotomy. 
“In much of what Freud wrote about 
these concepts, it is fairly clear that 
he did not think of them dichotom- 
ously, but as defining the extremes 
of a logical continuum. Any actual 
thought process, even that of a baby 
or a deteriorated schizophrenic, has 
to be located somewhere in between 
the poles” (7, p. 15). 

The continuum idea is essential in 
the current efforts to develop an index 
of pathological thinking. It implies 
that pathological thinking is neither 
totally present nor totally absent, but 
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present to some quantifiable degree. 
If this is so, such an index should 
make it possible to discriminate sig- 
nificantly between different diagnostic 
groups representative of varying de- 
grees of thought pathology and to 
measure clinical improvement or re- 
gression in patients, 

The Rorschach has been routinely 
used for making judgments about 
the mental status of patients with 
particular reference to the degree of 
irrationality of thought and distor- 
tion of perception. The usual meas- 
ure of this is the form level, whether 
it be estimated as an F+-% (2, 6) or 
rated on the Klopfer Form Level 
scale (10), From a theoretical point 
of view the form level concept has 
always been a troublesome one be- 
cause of its discontinuity with gen- 
eral clinical and experimental form- 
ulations regarding thought pathology 
(13, pp. 228-252). 

In a recent study, Friedman (5) 
has attempted to establish referrents 


for the form level concept in per- 


ceptual developmental theory. He 
accepts Werner's (16) definition of 
regression as a partial return to gen- 
etically lower levels within the indi- 
vidual, in which there is less differ- 
entiation and hierarchic integration 
of function than at higher ones. 
Friedman postulates that the Ror- 
schach reflects “certain aspects of 
perceptual functioning in schizo- 
phrenic patients which suggest that 
regression has taken place” (5, p. 
171). He compared schizophrenics 
with normal children and normal 
adults. His more general finding is 
that “on the whole, the results would 
suggest that the perceptual function- 
ing of the schizophrenic, in its struc- 
tural aspects, is intimately related to 
that of the child . . . From the point 
of view adopted in this study, its 
characteristics may be understood as 
those of a primitive globality, syn- 
cretism, lability, diffuseness, and rig- 
idity” (5, p. 184). These phenomena 
may be subsumed under Werner's 


55 


formulations regarding impairment 
in the capacity for differentiation and 
heirarchic integration. Friedman em- 
phasized that regression does not re- 
turn the schizophrenic to precisely 
the same level as the child occupies, 
for the adult psychotic still manifests 
many of the qualities of perceptual 
functioning that characterized him 
before regression occurred. 

A question may be raised about the 
adequacy of describing the processes 
involved in responding to the Ror- 
schach, in perceptual terms alone. 
Although Friedman intended to stay 
as close to the “purely structural as- 
pects of perceptual functioning as 
possible” (5), he could not avoid 
bringing in certain associative cate- 
gories as well, such as the fabulized 
combination and the contaminated 
response. 

This difficulty in distinguishing be- 
tween “the purely structural aspects 
of perception” on the Rorschach and 
the associative ones would appear to 
justify Rapaport’s (12) use of the 
perceptual-associative interplay con- 
struct. Normal subjects are able to 
utilize this interplay in order to ob- 
serve “reality” as it is implied in the 
test instructions. They “. . . will un- 
derstand the testing situation and 
the test instructions to mean that 
they are to give responses for which 
sufficient justification may be found 
in the perceptual qualities on the 
inkblot; that they must give responses 
that are completely acceptable to 
everyday conventional logic; and 
that, just as they should not give 
responses which they cannot confirm 
by reference to the inkblot, so they 
should not give responses which are 
so dominated by the perceptual con- 
figuration of the inkblot that they 
are no longer subject to critical con- 
trol, and thus become absurdly com- 
bined or absurdly integrated” (12, 
p. 236). 

Responses that disregard the per- 
ceptual qualities of the inkblot rep- 
resent an abnormal increase of dts- 








56 


tance from the blots; those that are 
so stimulus bound as to disregard 
ordinary logic and plausibility rep- 
resent an abnormal loss of distance. 
A deviant verbalization on the Ror- 
schach is one that represents an ab- 
normal increase or loss of distance 
from the blot. 

Using Rapaport’s categories of 
deviant verbalizations on the Ror- 
schach, Watkins and _ Stauffacher 
(15) developed an “Index of Patho- 
logical Thinking”. From Rapaport 
these two authors selected the fifteen 
categories of verbalization most 
markedly deviant or most frequent in 
occurrence. To these, tentative 
weights were assigned, representing 
the authors’ judgments regarding the 
degree and significance of pathology. 
For each Rorschach protocol studied, 
an average weighted score was cal- 
culated. The study by Watkins and 
Stauffacher (15) and a later one by 
Powers and Hamlin (11) are in essen- 
tial agreement regarding the relia- 
bility and validity of the Index of 
Pathological Thinking. In the first 
study two independent raters ob- 
tained the reliability coefficients of 
.043, .469, and .913 for a normal, 
neurotic, and psychotic group res- 
pectively. Scoring reliability for the 
three groups combined was .775. In 
the second study two raters independ- 
ently scored fifteen protocols selected 
at random from a total sample of 
fifty, and obtained an r of .88. In both 
studies the criterion of validity was 
the differences in mean scores for 
various diagnostic groups. Watkins 
and Stauffacher found significant 
differences between the means of the 
normal, neurotic and__ psychotic 
groups in the expected direction. 
Powers and Hamlin arranged five 
groups in the following assumed 
order of increasing pathology of 
thought: normal, anxiety neurotic, 
pre-schizophrenic, paranoid  schizo- 
phrenic, and catatonic schizophrenic. 
An F ratio significantly below the .01 
level was obtained, with the scores 
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increasing as expected. 

Problem: In the present study, the 
validity of the Index for measuring 
intra-individual changes in three sep- 
arate groups of schizophrenics, over 
a three-month period is investigated. 
Its reliability is also re-examined. 


METHOD 


Since the original scale devised by 
Watkins and Stauffacher was used 
with only minor modifications, it will 
not be reproduced here. The modi- 
fied scale of this study permitted a 
five-point rating for each response 
with the following values in the order 
of increasing pathology: .00, .25, .50, 
.75, and 1.00. In order to increase the 
reliability of scoring, a manual was 
developed with more detailed scor- 
ing instructions than those presented 
by Watkins and Stauffacher and in- 
cluding extensive lists of sample re- 
sponses taken largely from Rapaport 
(12, pp. 473-491). 

According to the general design of 
this study, changes in Index scores 
over a three-month period were cor- 
related with psychiatric ratings of 
clinical change. Three groups of 
schizophrenic subjects were used. 
Since the basic data analyses were 
carried out separately for the three 
groups, there was actually a sequence 
of three studies. Comparability of the 
groups is therefore not a require- 
ment. However, Table I indicates 
that the three groups are similar with 
respect to age. Table I presents the 
composition of each group and the 
treatment applied. 


TABLE I. Subjects of Study 
Sex Age 


Treatment N M F _ Rng. Mean 
Insulin Coma 15 15 22-43 31 
ECT 145 9 23-51 34 


Routine Hospital Care 12 5 7 18-55 33 


The only selective factor operating 
in the choice of subjects was the 
capacity to give at least ten responses 
to the Rorschach. Pre-treatment pro- 
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tocols were obtained from patients 
within a few days after admission to 
the hospital, and never more than a 
week before the beginning of Insulin 
therapy and ECT. Post treatment 
protocols were obtained approxi- 
mately three months after the first 
ones; this was approximately two 
weeks after the termination of treat- 
ment. For the Insulin group only, 
psychiatric ratings of clinical status 
were obtained immediately before 
treatment and both two weeks and 
six months after its termination. For 
all three groups psychiatric ratings of 
clinical change over the three-month 
period were made. These psychiatric 
ratings were used as the basic validity 
criteria. 
RESULTS 

Reliability 

Both the reliability of scoring and 
the split-half reliability of the Index 
were determined using only Insulin 
group protocols, The scoring relia- 
bility was estimated by two methods, 
the first based on the percentage of 
agreement between two raters of each 
separate response, the second based 
on the rank order correlation between 
the total scores of all the protocols 
(VN. = 38). The additional 8 Ror- 
schach records were obtained by re- 
peat testing of 8 patients six months 
after termination of Insulin therapy. 
In order to guard against the “halo” 
effect that might result when re- 
sponses are scored within the context 
of the entire protocol, each response 
was typed on a separate card and 
given a code number. The 1142 such 
cards were thoroughly shuffled before 
being scored by two raters working 
independently. The percentages of 
agreement between the raters on the 
sixteen different categories of the In- 
dex were very small, indicating low 
scoring reliability for the individual 
categories. The scoring reliability of 
deviation values, however, was quite 
satisfactory, as shown in Table II, 
which presents the number of re- 
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TasBLE II. Disagreement Between 
Two Raters in Scoring Separate Ror- 
schach Responses. 


Difference 
Between Number of 
Index Values Responses Percent 
.00 747 65 
25 305 27 
50 17 4 
BY 32 3 
1.00 ll 1 
Total Number of 

Responses 1142 100 


sponses on which the two raters’ scor- 
ing differed by a given Index value. 
A method of determining reliability 
by an analysis of variance (8), when 
performed on these data, yielded a 
reliability coefficient of .80. 

The second determination of scor- 
ing reliability was based on the total 
scores of 38 protocols. Since total 
scores (i.e. the sum of the deviation 
values) are positively correlated with 
the number of responses in the proto- 
col, the number of responses was par- 
tialed out. The resulting partial rank 
order correlation between the two 
raters gave a reliability coefficient of 
.85. The Index itself (sum of devia- 
tion values x 100/number of re- 
sponses) is independent of the number 
of responses; the correlation between 
the Index and the number of re- 
sponses was not significantly greater 
than zero. 


It should be noted that the ob- 
tained reliability coefficients of .80 
and .85 are not significantly different, 
though the first is a measure of the 
reliability of scoring individual] res- 

onses and the second is the reliabil- 
ity of the total Index score for the 
entire protocol. Thus it is evident 
that the comparatively high scoring 
reliability of the Index represents 
high inter-rater agreement on each 
separate response and is not an arti- 
fact of the “halo” effect that would 
result from scoring responses under 
a global impression of the whole 
protocol. 
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The Index would seem to lend it- 
self more justifiably to a determina- 
tion of split-half reliability than do 
most other Rorschach scores, since 
there is a less direct relationship be- 
tween the kinds of variables scored 
in the Index and the stimulus prop- 
erties of the inkblots than is the case 
with formal factors such as FC, FK, 
Fc, etc. In order to overcome to some 
degree the well-known objections to 
splitting the Rorschach on the basis 
of the cards, which has been the most 
usual procedure in other studies, the 
Index scores were split by taking 
every other response throughout each 
protocol. The rank order correlation 
between the two halves, after correc- 
tion by the Spearman-Brown form- 
ula, gave a split-half reliability co- 
efficient of .52. . 

Thus, scoring reliability in terms 
of scale values is high. However, in 
terms of agreement on individual 
categories, it is unsatisfactory. Split- 
half reliability is significant but 
mediocre in level. 

Validity 

The validity of the Index for dis- 
criminating between groups that rep- 
resent varying degrees of pathological 
thinking has been reported previ- 
ously (11, 15). In the present study 
the capacity of the Index to reflect 
clinically observable intra-individual 
changes is the main consideration. 
Actually two basic validity tests have 
been used: (a) the correlation be- 
tween the psychiatric rating of clin- 
ical status and Index scores, and (b) 
the correlation between the psychi- 
atric rating of clinical change and 
change in Index scores. 


The first validity test was carried 
out with the Insulin group only. The 
psychiatrist in charge of the Insulin 
unit rated the clinica] status of each 
patient on a five-point scale immedi- 
ately before the beginning of Insulin 
therapy, two weeks after its termina- 
tion (approximately three months 
after the first rating), and six months 
after its termination. These three rat- 
ings are designated as Pre-Insulin, 
Post Insulin I, and Post Insulin II in 
Table III, Both the Index scores and 
psychiatric ratings were dichoto- 
mized at the median and correlations 
were computed by Chi-Square based 
on four-fold tables. There are no sig- 
nificant Chi-Squares in Table III. 

The second validity test was based 
on the three groups of subjects. Since 
there were three sets of psychiatric 
ratings of clinical status for the In- 
sulin group, three ratings of change 
were made. For both the ECT and 
Routine Hospital Care groups there 
was only one psychiatric rating of 
change. Although the psychiatrists 
used five-point scales, these ratings 
were dichotomized into Improved 
and Unimproved for Chi Square 
computations. Index changes were 
similarly dichotomized. In order to 
achieve this dichotomization with In- 
dex scores they were first normalized 
and converted into standard scores 
with a mean of 50 and a SD of 10. 
All patients registering a drop on 
this Index of at least one Standard 
Error of Measurement in standard 
score terms were classified as Im- 
proved; all others were classified as 
Unimproved. There are no significant 
Chi-Squares in Table IV. 


In addition to the two basic val- 


TABLE III. Chi Squares* for Relationship Between Psychiatric Ratings and 
Index of Pathological Thinking Scores for the Insulin Group. 


Index** 

Scores N Pre Insulin 
Pre Insulin 15 05 

~ Post Insulin I 15 05 

+ 


** Dichotomized at the median. 


Psychiatric Ratings*** 


Post Insulin I Post Insulin II 


58 1.73 
$23 By 


Four-fold tables were used in computing X? and Yates’ correction applied. 


*** Psychiatric Ratings on a five-point scale were dichotomized at the median. 
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TasBLe IV. Chi Squares* for Relationship Between Change in Psychiatric 
Ratings and Change in Index of Pathological Thinking for Insulin, ECT, and 
Routine Hospital Care Groups. 

Change in Psychiatric Rating of Improvement ** 

Index Scores 

Pre to Post *** N Pre to Post I Pre to Post II Post [ to Post II 

Insulin group ; 08 05 O4 

00 

é O04 

Four fold tables were used in computing X? and Yates’ correction applied. 

** Dichotomized into Improved and Unimproved. 

*** Dichotomized into Improved and Unimproved. The criterion of improvement was a 
decrease of one Standard Error of Measurement (3.4 standard score units). Standard 
scores were based on normalized Index scores with a mean of 50 and a SD of 10. 


1 
ECT group 1 
RHC group ] 


* 


TasLe V. Rank Order Correlations Between F+%* and Index Scores 
Rho. 
Group N Pre Post 
Insulin ; 15 — 42 me 
ECT l4 = z5** — 553%* 
RHC 12 +.002 nee 
Combined 4] =e —.46%** 


* F4% scored according to Beck (2). Both F4+% and Index Scores ranked from highest 
to lowest. 

“| Fas 

oe: Poe 


TasLe VI. Pre and Post Index Scores for the Insulin, ECT, and Routine 
Hospital Care Groups 
Pre Post 
Group N Mean SD Mean SD Diff.* t 


Insulin 15 17.65 12.75 15.65 11.35 2.00 98 
ECT 14 23.76 12.75 18.77 13.66 4.99 1.06 
RHC 12 19.65 12.63 10.63 7.96 9.02 i 
Combined Groups 41 20.32 12.98 15.27 11.80 5.05 a ai 


* For the calculation of differences and their t-tests the Index scores were converted to 
normalized T scores with a mean of 50 and a SD of 10. 

-” Pas 

ee PD 


idity tests, two other analyses were Other findings with some relevance 
made that have some relevance to for validity are presented in Table 
validity considerations. In Table V_ VI. The mean Index scores for the 
the rank order correlations between three groups drop after the three 
the Index scores and F+% for the month period of hospitalization. 
Pre and Post Rorschach records of the When the groups are considered 
three groups are presented. Since it singly, only the Routine Hospital 
is assumed that a high F+% would Care patients register a drop that 
indicate a low level of pathology, approaches significance. With the 
negative correlations would be ex- groups combined, a highly signifi- 
pected. All but one of the correla- cant drop appears. 

tions are, in fact, negative. When the The data in Table VI may be com- 
groups are taken singly, only the pared with the means and standard 
correlations for the ECT group are deviations for schizophrenic patients 
significant. With the groups com- obtained in the previous studies. 
bined, both correlations are signifi- Thus, Watkins and Stauffacher (15) 
cant. obtained a mean of 18.15 and a SD 
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of 21.23 for their psychotic group. 
Their mean is rather close to the Pre 
mean in the present study. However, 
their variability is much greater. 
Powers and Hamlin (11) obtained 
mean scores for their pre-schizo- 
phrenic, paranoid schizophrenic, and 
catatonic schizophrenic groups of 
20.53, 21.00, and 33.50 respectively. 
It is apparent that these means are 
higher than those obtained both by 
Watkins & Stauffacher and by the 
present authors. 


DISCUSSION 


While the two previous studies 
(11, 15) demonstrated the validity of 
the Index in discriminating between 
normal, neurotic, and __ psychotic 
groups, the present study fails to 
demonstrate the validity of the Index 
in measuring changes within schizo- 
phrenic subjects over a period of 
time. It may be said that the Index 
is a sufficiently fine measure to dis- 
tinguish between groups but too gross 
to reflect intra-individual changes. 
However, this conclusion should be 
considered in the light of the known 
low reliability of psychiatric ratings 
(14). Certainly the significant drop in 
level of pathological thinking, as 
measured by the scale over a three 
month period of hospitalization, ac- 
cords with expectation. It presents 
some hope for more positive results 
with better validity criteria. 

Meanwhile, much can be done to 
sharpen the scale and perhaps in- 
crease its sensitivity. High reliability 
of scoring has been demonstrated for 
the scale as a global measure of patho- 
logical thought. Agreement is con- 
siderably lower for specific categories. 
Due to the infrequency of occurrence, 
some categories might well be 
dropped. The result would be a sim- 
plification of the scale with little loss 
in comprehensiveness. A few of the 
categories in which agreement was 
particularly low were found to over- 
lap with others. In such cases cate- 
gories could be combined, resulting 
in further simplification of the scale. 


During the course of eliminating and 
combining these categories, a sharp- 
ening of scale definition could be 
undertaken. There might be a fur- 
ther increase in the accuracy of the 
scale if all the categories with the 
same weights were grouped together. 
Such a re-arrangement is suggested 
by the high level of agreement be- 
tween raters for degree of pathology, 
in spite of disagreement for specific 
categories. 


Powers? is following a different 
course in his revision of the Index. 
He abstracted ten categories from 
Rapaport’s formulations regarding 
deviant verbalizations on the Ror- 
schach. These he later combined into 
four classes, which he designated in- 
tellectual disorganization, socially 
deviant content, inappropriate in- 
crease or loss of distance, and affect- 
ive response. All categories were set 
up as continua, ranging from a value 
of 10 to a value of 50 in 5-point inter- 
vals. In this manner Powers has elim- 
inated the arbitrary weighting of dif- 
ferent categories. Empirical investiga- 
tion rather than initial assumption 
then becomes the means of determin- 
ing the degree of pathology repre- 
sented by each category and class. 
The authors of the present study are 
reluctant to follow this course for two 
reasons. The first is the high relia- 
bility obtained by using the present 
five-point scale weights and the sec- 
ond is the very low reliability ob- 
tained for the separate categories. 


Holt’s (7) work on developing a 
primary process index based on the 
Rorschach is also relevant here. 
Holt’s index is not geared to detect 
pathological thinking per se, but 
rather all manifestations of the pri- 
mary process. It is therefore much 
broader in scope than the Index of 
Pathological Thinking, encompass- 
ing an “index of drive—directedness of 
thought”, a measure of the formal 
thought characteristics of the pri- 





? Personal communication. 
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mary process, as well as an evaluation 
of “the subject’s attitude toward the 
test and toward his own productions, 
and the extent to which he is master 
of or is mastered by the primary pro- 
cess elements in his thinking” (7, 
p- 22). The third section of Holt’s 
index has many elements in it which 
may well be incorporated in the 
present scale. For instance, a response 
that appears ——- may actu- 
ally be quite benign if it is given in 
an aesthetic, anthropological, fairy- 
tale, intellectual, or humorous con- 
text. Frequently an apparently bizarre 
response may be given as a play of 
fantasy enjoyed by the subject. Con- 
siderations such as these must in some 
way be integrated into the scoring of 
the Index in order that truly patho 
logical responses may be distin- 
guished from those that are only ap- 
parently so. 

The moderate but significant cor- 
relations between the Index and 


F+4% accords with theoretical expec- 


tation. Although the F+¥% is not a 
pure measure of the structural as- 
pects of perception, it probably en- 
compasses relatively more of percep- 
tion and less of association in the 
perceptual-associative interplay than 
most of the categories of verbal res- 
ponse described in the Index. Powers 
has incorporated F+-% into his scale 
and it may well prove advantageous 
to incorporate it in the present one. 


SUMMARY 


Two recent studies (11, 15) have 
shown that an Index of Pathological 
Thinking on the Rorschach, based on 
Rapaport’s classification of aberrant 
verbalizations, discriminates between 
psychotic, neurotic, and _ normal 
groups. The present study re-exam- 
ines the reliability of the Index and 
investigates its validity against the 
criterion of observed clinical changes 
in schizophrenic patients. 

The subjects were three groups of 
schizophrenic patients receiving dif- 
ferent forms of treatment: Insulin 
Coma, Electro-Convulsive Therapy, 
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and Routine Hospital Care. The Ror- 
schach was administered to all Ss 
shortly after hospital admission. In- 
sulin Coma and ECT were begun a 
few days later and terminated after 
about three months. Rorschachs 
were repeated two weeks after the 
termination of treatment. In the non- 
treatment group the Rorschach was 
repeated three months after its first 
administration. The psychiatrist 
working with the Ss assigned ratings 
of clinical status before treatment as 
well as change in status (improved- 
unimproved) after treatment (or 
after routine hospital care). 


The scoring reliability of the In- 
dex as a whole was satisfactory (.85). 
The split-half reliability (odd vs. 
even numbered responses in sequence 
throughout the protocol) was .52. 


No significant relationships were 
found between Index scores and psy- 
chiatric ratings of clinical status or 
between change in Index scores and 
psychiatric ratings of change. How- 
ever, the combined groups showed a 
significant (p<.01) average decrease 
in pathological thinking as measured 
by the Index over the three month 
interval covered by the study. 
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Sources of Variance in Students’ Rorschach Interpretations 


Davin A. RopGERS 
University of California 


Recent reviews (1) (3) (6) of Ror- 
schach experimentation strongly em- 
phasize that one major gap in our 
knowledge about this widely used 
and often investigated test concerns 
the source of “information” that 
enters into an interpretation of the 
test. Is it the formally scored dimen- 
sions of the test? The unscored pro- 
tocol? Observations of the subject 
apart from the protocol itself? Addi- 
tional information about the subject, 
such as case history records? The im- 
agination and projections of the clin- 
ician? “Pure chance” variations in 
the clinician’s vocabulary usage? All 
of these variables, of course, probably 
have some influence, but the crucial 
question is, how much influence does 
each of these and other possible fac- 
tors have. 

Ideally, for maximal independence 
and objectivity, every interpretation 
should be dictated solely by the test 
situation, and preferably, for later 
review and blind analysis, by the test 
protocol alone. Such, realistically, can 
not always be the case; and it would 
seem highly desirable to know what 
factors have how much influence on 
Rorschach interpretations. 


The present study is an assessment 
of kinds and degrees of influence on 
blind interpretations made by stu- 
dents in a beginning course on the 
Rorschach. 


DESIGN OF EXPERIMENT 


Specifically the present study at- 
tempts to assess what influence the 
following variables have on Ror- 
schach interpretations concerning a 
selected variety of human behavior: 
(1) Rorschach protocol content, (2) 
individual student differences; and 
(3) didactic instruction on the use of 
the Rorschach, 


Items of behavior. It was desired 
that the kinds of behavior about 
which interpretations were to be 
made be the same for all interpreta- 
tions, be applicable to both clinic 
cases and non-clinic cases, be non- 
Rorschachese (so that the interpreta- 
tions might possibly reflect more than 
rote learning or mechanical substitu- 
tion of words for scores), be amenable 
to statistical treatment, and be repre- 


‘sentative of a fairly wide range of 


human behavior that might reason- 
ably be assessed by the Rorschach. 
For this purpose, a 108-item Q-sort! 
roughly representing Murray’s need- 
press variables (4) was chosen. These 
variables were felt to meet the above 
criteria satisfactorily, By requiring 
interpretations to be made in the 
form of the Q-sort distribution, it 
was possible to insure good variabil- 
ity of response and to simplify con- 
siderably the problem of statistical 
treatment. The Q-sort distribution 
also made possible certain additional 
analyses that are not dealt with in 
the present study. 

Rorschach protocols. The protocols 
to be evaluated were two dittoed ver- 
batim typescripts with no identifying 
information except that the subjects 
were adult males. During the study 
no additional information was sup- 
plied about the subjects. They were 
in fact two non-patient industrial em- 
ployees tested for research purposes. 
Neither was considered particularly 
maladjusted either by himself or by 
his immediate associates. The sole 
criterion of selection, in addition to 


+A detailed description of this Q-sort, to- 
gether with a list of the items, appears in 
the author’s doctoral dissertation (5). Many 
of the items were borrowed from a set pre- 
pared by Morris Stein and George Stern. A 
sample statement: “I finish most everything 
I start.” 
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the availability of the protocols, was 
that one subject was rated high in 
work efficiency and the other was 
rated low. Clinically, both protocols 
contained evidence of some malad- 
justment, as might be expected. 

Students. The students were the 
author’s beginning class in Rorschach 
technique. The total class consisted 
of twelve students, two of whom 
could not be included in the study 
because of failure to complete the 
assigned task. The remaining ten con- 
stitute the student population used. 

Instruction. The instruction con- 
sisted of approximately two months 
of lecture, discussion, and fieldwork 
experience on interpretation of the 
Rorschach. It was the standard intro- 
ductory course in the use of the Ror- 
schach. 

Two parallel studies were run. For 
the study of clinical evaluations, the 
students were asked to make Q-sort 
clinical descriptions of the subjects. 
For the self view evaluations, the stu- 
dents were asked to postdict the self- 
concept Q-sorts of the subjects. These 
data were treated in separate parallel 
analyses and, as will be seen, yielded 
highly similar results. Unless other- 
wise indicated, all remarks to follow 
apply equally to either of these two 
parallel parts of the study. 

Each student prepared two descrip- 
tive Q-sorts and two self-concept Q- 
sorts for each of the two subjects. One 
sort of each type was completed prior 
to the beginning of instruction. The 
remaining ones were prepared after 
two months of instruction had been 
completed, The students were asked 
not to discuss the cases among them- 
selves and not to collaborate in eval- 
uating them. Prior to completion of 
the study, they were not given any 
feedback about their results or about 
the specific cases. For both the pre- 
and post-instruction evaluations, they 
were allowed to use whatever infor- 
mation and help they could obtain 
from textbooks and the literature. 


The data were evaluated by means 


of a four-way analysis of variance 
with one entry per cell. The primary 
dimensions of the analysis were (1) 
Q-items, (2) students, (3) protocols 
and (4) series — ie., pre- or post- 
instruction. These and all possible 
interactions are shown in Table I, 
along with the results of the study. 
The dependent variable being as- 
sessed is the score assigned by a stu- 
dent to a Q-item description of be- 
havior, after exposing himself to a 
Rorschach protocol and to varying 
amounts of information about the 
Rorschach. For each of the two paral- 
lel aspects of the study, there were 
4320 assessments of this dependent 
variable, independent except for the 
forced-distribution characteristics of 
the Q-sort and, of course, the strati- 
fied nature of the variance design. 
The primary effect of the forced Q- 
distribution is to make impossible the 
independent assessment of three of 
the four primary effects and of 
any interaction not involving Q-items 
as one dimension, there inevitably 
being zero variance among any set 
of means derived by summing across 
items, since the means of all the Q- 
sorts are identical. This is a pseudo- 
loss that is of no consequence for the 
present study, the relevant informa- 
tion being contained in the effects 
that are assessable. A secondary, but 
potentially more serious effect of the 
forced distribution, is to introduce a 
slight negative average intercorrela- 
tion between Q-items, thereby violat- 
ing the variance analysis assumption 
of complete independence of sampl- 
ing. Although serious if small num- 
bers of items are involved, this is as- 
sumed to have negligible effect with 
a 108-item sample. 


In addition to the significance of 
the various effects, the contribution 
of each significant effect to total vari- 
ance of the raw score is also determ- 
ined, following Haggard’s discussion 
of variance designs for random mod- 
els (2). The reasoning involved is as 
follows: The raw score variance, o,’, 
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of the dependent variable in a vari- 
ance design is the sum of incremental 
contributions (Ao,* in Table I) of 
the independent sources of variance 
in the stratified design. For example, 
in a simple design involving m items 
per cell and &k cells, independent 
sources of variance would be the error 
variance, o,7, and the variance con- 
tributed by the dimension that de- 
termined the classification of the data 
into cells, o,7. Raw score variance, o,’, 
would then equal o,” + o,*. Approxi- 
mations of these variances can be ob- 
tained from the estimates of variance, 
S,.° and §,?, used for the variance an- 
alysis. S,° is a direct estimate of a,?. 
Similarly, 5S,*?, computed from the 
variance of the cell means, is an esti- 
mate of o.°+ moa. Solving these ap- 
proximate equations, an approxima- 
tion of o,2 can be obtained: o,?~ 
~~’ . Similarly, o.7 ~S,? + 
m 
S,7—S,,? 


“_. The solution can be gener- 
m 


alized to determine the increments 
of the probable raw score variance 
contributed by each effect of variance 
analysis designs of almost any com- 
plexity. 

Results and Discussion, The results 
of the analyses are summarized in 
Table I. Of the seven sources of vari- 
ance, three are found to be significant 
at beyond the .001 level for both the 
clinical evaluations and the self view 
postdictions. One additional effect 
is found to be significant at the .05 
level for the self view. The other ef- 
fects do not approach acceptable sig- 
nificance levels. 

The three clearly significant sources 
of variance are (1) the differential 
influence on item scores of the proto- 
cols themselves, (2) individual stu- 
dents’ idiosyncratic interpretations of 
the protocols, and (3) the differential 
influence of instruction on interpret- 
ation of individual protocols. 


All of these sources of variances 
are, appropriately, related to the pro- 


tocols themselves. They indicate that 
even beginning students of the test 
are significantly influenced by the 
contents of the protocols. 


The item-by-student-by-protocol in- 
teraction indicates that there are indi- 
vidual differences in interpretation of 
the protocols and suggests the range 
of individual] skill or idiosyncracy in- 
volved in the interpretations, 

The item-by-protocol-by-series — in- 
teraction suggests that instruction sig- 
nificantly influences the interpreta- 
tions of protocols. Two major reser- 
vations regarding this evaluation 
should be made, however. The first is 
that no control group was used to 
determine the effect of mere repeti- 
tion of the task, so that the significant 
interaction possibly could be due to 
repetition alone, with the didactic 
material being a total waste except as 
interposed material to fill time be- 
tween trials one and two. This con- 
sideration is made less important, 
however, by the second reservation, 
which has to do with the amount 
rather than significance of this vari- 
ance. Although highly significant, this 
interaction contributes only three to 
four percent of the probable raw 
score variance, as shown in the last 
columns of Table I. If this contribu- 
tion to variance can in fact be attrib- 
uted solely to instruction and clinical 
experience rather than partially or 
wholely to task repetition, it is still of 
such low magnitude that one wonders 
whether there is sufficient value in a 
formal course on interpretation to 
justify its existence. These results do 
not of course pertain to the advisabil- 
ity of formally teaching the _ tech- 
niques of administration and scoring 
of the test. Nor can they necessarily 
be generalized to other instructors’ 
methods of handling such a course, 
although all of the students involved 
were receiving multiple Rorschach 
instruction, from field work super- 
visors and from clinic staff as well as 
from the classroom instructor, during 
the training interval, so that at least 
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in this case the collective effect of 
several methods of instruction was 
discouragingly small. 

That the test could be used mean- 
ingfully even without formal instruc- 
tion in evaluation is suggested by the 
fact that from 20 to 23 per cent (see 
Table I) of the probable raw score 
variance in the interpretations of 
these beginners is attributable to the 
protocols themselves, quite apart 
from any influence of instruction be- 
yond that contained in textbooks and 
such materials, (It should perhaps 
be pointed out that the question of 
whether the interpretations are valid 
or not, i.e. their “correctness”, is not 
being considered in the present study, 
which is concerned exclusively with 
the sources of variance whether or not 
such variance contributes to valid 
interpretations.) 

Individual differences in interpret- 
ation of the protocols account for an- 
other 15 to 19 percent of the probable 
raw score variance, indicating. that 
individual “artistry” of interpretation 
is a rather large source of variance. 


Of perhaps more sobering import is 
the fact that from 50 to 58 percent — 
over half — of the probable raw score 
variance must be considered error 
variance. Hopefully, this percentage 
would be markedly lower for experi- 
enced clinicians, although the pres- 
ent study indicates that two months 
of intensive experience even for in- 
itially naive interpreters has very 
little influence. It is possible, even 
probable, that other behavior items 
than those sampled by the present 
Q-sort might, if selected to represent 
common Rorschach _ interpretations, 
considerably reduce the unaccounted- 
for variance. However, they might 
also increase the tendency toward 
meaningless stereotypical interpreta- 
tions. These are matters to be assessed 
in further research. 

Dimensions not found to be rele- 
vant sources of variance are (1) the 
Q-items used, (2) the individual stu- 
dent treatment of Q-items, and (3) 
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the differential effect of course in- 
struction on treatment of Q-items. 
The differential effect on instruction 
on individual student treatment of 
Q-items fails of significance in the 
clinical evaluations and attains ques- 
tionable significance in the self eval- 
uations. Considering the large size 
of the populations involved in these 
evaluations, their failure to attain ac- 
ceptable levels of significance strong- 
ly suggests that they contributed neg- 
ligibly to the total variance. These 
results indicate that at least in the 
present study, no “Rorschach stereo- 
type” emerged. Contrary to a rather 
popular opinion, no stereotype such 
as “social acceptability” of the Q- 
items or “general pathology” or the 
like seemed to influence the sortings 
significantly. Course instruction seems 
to neither increase nor decrease the 
tendency toward such stereotypy and 
the individual student seems to be as 
immune to it as is the group as a 
whole. While these results are grati- 
fying, they must also be wondered at. 
The protocols selected for evaluation 
were from a presumably rather homo- 
geneous population that might be 
expected to have some legitimate 
“stereotypy” in it, since the subjects 
occupied the same, somewhat nar- 
rowly defined, social role. Neverthe- 
less for whatever reasons, these ef- 
fects showed no significance in the 
present study, possibly because of the 
diversity produced by selecting two 
subjects who differed greatly in role 
ability even though they occupied the 
same role. 


SUMMARY 


The study attempted to identify 
the relevant sources and amounts of 
variance of Rorschach interpretations 
made from blind protocols, by stu- 
dents just learning the technique. 
Course training was found to have a 
significant but small influence on the 
interpretations. The protocols them- 
selves accounted for approximately 
one-fifth of the probable raw score 
variance. individual differences in 
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interpretation of protocols accounted 
for only slightly less variance. Unac- 
counted for, or error, variance was 
found to make up over half of the 
probable raw score variance. Stereo- 
typy of interpretation, independent 
of the particular protocols being as- 
sessed, was not found. 
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Use of the Inspection Rorschach Technique in Analyzing 
Missionary Success and Failure 


SALEEM ALAM SHAH! 
Pennsylvania State University 


The problem of adequate selection 
methods is one that has faced mission 
boards ever since missionaries have 
been sent to foreign fields. It has 
been only within the last two decades 
that progressively extensive use has 
been made of psychological testing 
to determine the abilities, interests, 
and personality factors of the mis- 
sionary candidates. The present study 
was concerned with the problem of 
aiding in the selection of foreign 
missionaries, A total of 206 American 
missionaries belonging to 11 major 
mission boards participated in this 
study. 

These missionaries were given the 
group Rorschach just prior to their 
departure for the mission fields,.“The 
protocols were analyzed after a period 
of seven years had elapsed from the 
time of administration of the Ror- 
schach so as to make available an 
adequate judgment of the work of 
the missionaries in the mission field, 
against which their Rorschach per- 
formance could be compared. 


PROBLEM 


The purpose of this study was: 

1. To determine the possibility of 
differentiating those missionaries who 
had been rated as “successful” from 
those rated as “unsuccessful” by anal- 
yzing their performance on the group 
Rorschach, using Munroe’s Inspec- 
tion Technique for the Rorschach 
protocol, 

2. To construct a predictive form- 
ula which could help in the selection 
of missionary candidates. 

3. To test the hypothesis that “un- 
successful” missionaries tend to be 
less well ‘“‘adjusted” than those who 


‘Currently at Spring Grove State Hospital, 
Baltimore, Maryland. 


are rated as “successful”, using the 
Inspection Rorschach adjustment 
score as a measure of “adjustment”. 


METHOD 


The group Rorschach was admin- 
istered using standard 35 mm slides 
according to the method recommend- 
ed by Harrower and Steiner (1). After 
the ten slides had been shown, each 
for a period of three minutes in the 
upright position, the subjects were 
asked to turn to the location sheets 
which had been provided. Standard 
instructions were then given for the 
location of the responses and for ob- 
taining the inquiry. The slides were 
projected again for a period of two 
minutes each for obtaining this in- 
formation. 


All the protocols were then scored 
according to Klopfer’s system, after 
which the data was entered into a 
modified form of Munroe’s check list. 
Thirteen additions were made to 
Munroe’s check list items for the pur- 
pose of the present study in the hope 
that they might help in differentiat- 
ing the groups under study, viz, the 
successful and the unsuccessful mis- 
sionaries. The additions to the check 
list and the reliability analysis of the 
Rorschach scoring and check list com- 
pletion have been explained in detail 
by the writer elsewhere (5). 


Criteria for Rating the Missionaries 


Since the subjects for this study be- 
longed to 11 different mission boards 
the ratings of the subject’s field per- 
formance were to be done by 11 per- 
sonnel secretaries. In view of the 
large number of raters involved it 
seemed imperative that the criteria 
for successful and unsuccessful be as 
objective as possible. 
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The following criteria were used to 
rate the subjects: 

“Successful” missionaries were those 
who had continued as missionaries 
during the period of seven years since 
they had been given the group Ror- 
schach, and who as such, could be 
considered as having made a success- 
ful adjustment in the limited sense 
that they had neither resigned nor 
been asked to leave the mission field. 

“Unsuccessful” missionaries were 
all those who had resigned or had 
been asked to leave the mission field 
and who thus could not be considered 
to have made the successful adjust- 
ment defined above. 

It was not possible for the person- 
nel secretaries to place every mission- 
ary into one of the above categories. 
In each case where there was not suf- 
ficient information to make the judg- 
ment, or, where the missionary left 
his employment for purely health 
reasons or due to compelling external 
circumstances, the personnel _ secre- 
taries were asked to use a third cate- 
gory, thereby removing that individ- 
ual from consideration in the study. 
Statistical Procedure 

The method of multiple regression 
was used, and the group of 206 sub- 
jects was divided into two sub-groups 
for the purpose of cross-validation. 
It was judged to be important that 
the sub-groups be divided with due 
consideration to the problem of 
matching them for the three variables 
which were present in the entire 
group, i.e. marital status, mission 
board, and country of service. The 
total group was divided into two us- 
ing stratified random sampling. 

Data for Group A were analyzed to 
find a predictive formula. Biserial 
coefhcients of correlation between 
each check list item and the criterion 
were computed, using the score ob- 
tained by the subjects on the various 
check list items, Six check list items 
having the highest biserial correla- 
tions with the criterion of successful 
and unsuccessful were used to com- 


pute a multiple regression equation. 
The coefficient of multiple determina- 
tion, the multiple R, and the b-coef- 
ficients were also computed. A simi- 
lar analysis was then made for Group 
B, using the same six check list items 
which had been used with Group A. 

By comparing the multiple R’s 
obtained by these two groups and 
also by comparing the coefficient of 
multiple determination and_b-coef- 
ficients, it was possible to determine 
whether or not the predictive formu- 
la had held up adequately under 
cross-validation. 

The remaining problems dealt 
with testing the hypothesis that “Un- 
successful’’ missionaries tend to be 
less well “‘adjusted” than those who 
are rated as “successful”, To do this 
the difference which existed between 
the mean number of checks obtained 
by the successful and unsuccessful 
missionaries had to be determined. 
The number of checks obtained by 
each individual was held to represent 
a measure of “adjustment” (4). One 
could then test the hypothesis that 
the two groups were samples from a 
population in which the actual mean 
difference was zero. 

RESULTS 

Table I shows the results obtained 
when _b-coefficients were computed 
for six items for the check list for the 
validation and the cross-validation 
groups. This table also shows the 
results obtained for the two groups 
when the coefficients of multiple de- 
termination and the multiple R’s 
were computed. It is evident from 
Table I that the results obtained 
from the validation group failed to 
hold up when subjected to cross-val- 
idation. The predictive equation is 
therefore of very little value. 

On testing the hypothesis that “un- 
successful” missionaries tend to be 
less well “adjusted” than those rated 
as “successful”, it was found that 
though the unsuccessful missionaries 
had a higher mean number of checks 
than that obtained by the successful 
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TaBLeE I. Comparison of the Statistical Analysis 
for the Validation and Cross-Validation Groups. 


R2 
2721 
1345 


Validation Group 
Cross-Validation Group 


b-coefficients 


Validation Group 
+.1649 
—.2609 
—.0372 
—.1200 
+ .0886 
—.3638 


S.E. of 
Multiple 
Estimate R 
3350 5216 0735 
4250 3667 .0890 
Cross-Validation Group 
+.1394 
+.0831 
+.0069 
+ .2825 
4.1868 
—.0434 


S.E. of R 


TABLE II. Mean Number of Checks Obtained by Successful 
and Unsuccessful Missionaries on Munroe’s Items 
and Items Used in Study. 


Successful 
(N = 156) 
Mean SD 


6.69 3.80 
8.15 4.47 


Munroe’s Items.............. 
All Items 


Unsuccessful 


Mean t 


(N = 50) Difference Ratio 


Mean SD 
7.66 3.71 97 
9.30 


1.585* 


4.32 1.15 1.611* 


*A t value of 1.972 is required for significance at the .05 level. 


missionaries, thus showing a trend 
in the direction of the hypothesis, 
the difference when tested by the use 
of t was found to be insignificant at 
the .05 level. This finding is shown 
in Table II. 


DiIscussION 


The results of this study apply 
only to the particular modification of 
the Rorschach used here and to the 
procedures used in this study. It is 
evident that, using the Inspection 
Rorschach, it was not possible to find 


consistent differences between the 
performance of missionaries who had 
been rated as successful and unsuc- 
cessful on the basis of their actual 
field work, An analysis of the valida- 
tion group showed that there were 
some items which seemed to differen- 
tiate the groups adequately, however, 
under cross-validation these items 
proved to be of little value. The im- 
portance of cross-validating such find- 
ings is clearly indicated by this study. 
In considering these results an ex- 
planation might be sought in the 
type of criteria used for rating the 
missionaries, further, the adequacy 


of the test used might be called into 
question, It is the view of the writer 
that under the circumstances of this 
study objective criteria, such as were 
used, are essential even though it 
could perhaps be argued that they 
might not differentiate the subjects 
as well as some more subjective rat- 
ings. If such a study is to be repeated 
and the results explained as object- 
ively as possible the present criteria 
seem to be necessary. The writer is 
of opinion that the Individual Ror- 
schach could do a more adequate job 
of differentiating the group under 
study here. Drawbacks to the use of 
the Individual Rorschach in this sit- 
uation are the large number of per- 
sons involved, the consequent time 
factor, and the far greater expense in- 
curred by such a procedure. 

An explanation of the insignificant 
findings might be sought with regard 
to the specific hypothesis tested. Pre- 
suming that the measure of “adjust- 
ment” was adequate, one would ex- 
pect to find significant differences in 
the two groups if the factor of general 
personality adjustment had been im- 
portant to success in the mission 








field. It is the opinion of the writer, 
and Thayer’s findings seem to sup- 
port this view (6), that the factor of 
general personality adjustment is im- 
portant in missionary work in foreign 
fields. If then we do not obtain a 
significant difference between the suc- 
cessful and the unsuccessful mission- 
aries it would appear to reflect upon 
the adequacy of the test used to meas- 
ure “adjustment”, and also upon the 
assumption that such a difference 
should exist. 

There are also some cross-cultural 
factors involved in a study of this 
sort; a personality adjustment pattern 
which in the American culture might 
not be considered too desirable might 
be just the kind of adjustment re- 

uired to make a “successful” mis- 
sionary in certain other cultures. And, 
while it is a fair assumption that 
whatever ihe nature of missionary 
“success”, and no one seems to know 
just what it is, certain personality 
factors would appear to play an im- 
portant part in it, yet, the nature and 
importance of these factors appears 
to be little known at the present 
time. 

Further research using projective 
techniques and other psychological 
tests needs to be done in this field. 
Though such tests, particularly pro- 
jective —- are being used ex- 
tensively for the selection of mission- 
aries the writer has seen little pub- 
lished work relating to a statistical 
analysis of the actual effectiveness 
and predictive value of such tests. In 
studies which endeavor to set up pre- 
dictive criteria on the basis of psy- 
chological tests, it seems very essential 
that the results be cross-validated be- 
fore any definite evaluation of the re- 
sults is made, 


SUMMARY 


The present study concerned 206 
American missionaries working in 
foreign fields. The purpose of the 
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study was to try to determine if mis- 
sionaries who had been rated as “‘suc- 
cessful” and “unsuccessful” using 
their field work as a criterion, could 
be differentiated on the basis of their 
Rorschach performance. And, if so, to 
construct a predictive formula for 
the selection of missionaries using 
the Inspection Rorschach Technique. 
The hypothesis that, “unsuccessful” 
missionaries tend to be less well “‘ad- 
justed” than those who are “success- 
ful‘. was also tested. 


The findings of this study were in- 
significant in each case. Though six 
items from a modified form of Mun- 
roe’s check list showed promise of 
differentiating the successful and un- 
successful missionaries, on cross-val- 
idation the results failed to show any 
significance. With regard to the spe- 
cific hypothesis tested it was found 
that although a trend in the direction 
of the hypothesis was indicated, yet 
the difference was not significant at 
the .05 level. The value of cross-val- 
idating the findings of such studies 
is indicated by this study. 
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Mosaic Patterns of Eighth Grade Children 


UrsuLA STEWART 
Elmont, New York 
LORRAINE LELAND AND EDITH STRIETER 
Manhasset, New York 


The purpose of this study is to 
determine the types of mosaic pat- 
terns made by the early adolescent; 
to observe developmental trends; to 
note whether sexual differences are 
reflected; to study the predictive value 
of specific patterns (such as had been 
found in an earlier study with first 
grade children (3) and by other work- 
ers concerned with differential diag- 
nosis) (4); to note any cultural diff- 
erences that might be found between 
American and English children of 
this age as had been observed in a 
previous study. (2) 


SUBJECTS 


In order to have as unselected a 
group as possible, all eighth grade 
children in a Long Island public 
school were examined for several suc- 
cessive years. The total sample of 125 
ranged in age from 11 years, 3 months 
to 15 years, with the greatest number 
falling at the 13 year level. 


TasLeE I. Age Range 


Age Percentage 
11 0.8 
12 14.2 
13 70 
14 13 
15 2 


There were 71 boys and 54 girls. 
With the exception of 1 Negro girl 
and 1 Japanese-American boy, all 
children were white and came from 
average income homes. Intelligence 
test results were skewed positively, a 
fact not surprising in view of the ex- 
clusion of the seriously mentally re- 
tarded from the regular classes and 
the fact that children in this district 
are known to have a median in the 
bright normal category. The I.Q.’s in 


the group ranged from 67 to 144 with 
the distribution given in Table II. 


Tas_e II. 1.Q. Range 


1.Q. Percentage 
Under 70 0.8 
70-79 1.6 
80-89 5.6 
90-99 16. 
100-109 25.6 
110-119 28. 
120-129 10.4 
130-139 9.6 
140-149 2.4 


The two examiners, well known to 
the children; included the mosaic in 
the routine battery of tests given each 
eighth grade child prior to his ad- 
mission to high school. The boys and 
girls were on the whole interested 
in the tests since the results were dis- 
cussed with them (and at a separate 
session with the parents) with a view 
toward helping them select the ap- 
propriate high school course. Thus, 
in addition to the individual intelli- 
gence test (either the Stanford-Binet 
or the Wechsler-Bellevue) and the 
mosaic, group vocational interest and 
aptitude tests were administered. 

The Lowenfeld Mosaic Test ma- 
terials are 456 plastic pieces compris- 
ing five shapes and six colors which 
are presented to the subject in a box 
and arranged according to shape and 
color. Lowenfeld’s selection of shapes 
was originally based on what she 
found to be the “fundamental” pat- 
terns of European folk design. A tray 
is placed directly in front of the sub- 
ject with the box to one side. One of 
each type of chip is placed on the 
tray by the examiner. When these 
have been replaced in the box the 
subject is instructed to “make any- 
thing you like”. This is the standard 
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procedure for children as worked out 
at the conference held at the Catholic 
University, Washington, D.C., May 
27, 1950. Colored tracings are kept 
of each subject’s performance togeth- 
er with notes concerning his attitude, 
method of attack, whether he was 
satisfied with his performance, etc. 

In 1956, that is from three to five 
years after the subject had been test- 
ed, a follow-up rating was given each 
child based on the principal’s and 
assistant principal’s comments. Al- 
though the boys and girls had by this 
time passed on to secondary schools 
outside the district, the present status 
of 90% of the original group was 
known to these administrators. This 
was due to the following factors: aca- 
demic ratings were routinely sent to 
the originating school; any unusual 
circumstances were usually discussed 
with these administrators; the small 
size of the community gave ample op- 
portunity to observe these children 
in other than the school setting. 

An Adjustment Rating I was as- 
signed for outstanding adjustment, 
both academically and socially. 10% 
of the group fell in this category. 
Samples of comments are: “boy is 
active in schoo] affairs; is president 
of the student council; is tops in his 
class (with a 95 average); plans to go 
to engineering school.” “ . . . girl 
just graduated from high school, 
commercial course. Received several 
awards for scholarship and athletics; 
socially active; chairman of Senior 
Prom, etc.”’. 

Adjustment Rating II implies ade- 
quate adjustment socially and aca- 
demically to the extent of which sub- 
ject is capable, This rating was given 
to 67.4% of our sample. Typical com- 
ments of the administrators are: “He 
is now going to a private military 
school since his father, a sea captain, 
feels all children need more discipline 
than provided in public schools. The 
boy looks well, likes his school and 
ranks at the top of his class.” “This 
girl is going to a private secondary 


school where she is getting good 
grades; she is very pretty and well 
liked.” 

11% of the children came under 
the category of Adjustment Rating 
III. In these cases, the administrators 
felt there was evidence of serious mal- 
adjustment. For the boys this usually 
meant pre-delinquent or delinquent 
behavior which had come to the at- 
tention of the court officially or un- 
officially (stealing a car, breaking and 
entering, vandalism, etc.); while for 
the girls this usually meant sexually 
promiscuous behavior along with re- 
fusal to observe school rules, etc, The 
present status of 10% of the group 
was unknown while 1.6% had died. 


RESULTS 


The classification of the mosaic 


patterns made by these eighth graders 
is given in Table III along with the 
percentage falling in each group. The 
terms employed by Dr. Lowenfeld in 
her recent book (1) have been used 


as much as possible. 
Representational classification. As 
seen in Table III, 68% of the entire 
group made this type of mosaic. 
These are further divided as follows: 
Kite: Only one individual, a girl 
of normal intelligence, made this 
type of design. She was rated in the 
follow-up as “poor” in adjustment. 
Direct representations: This type of 
representational pattern, made by 
2/3 of the group, can be interpreted 
as one does drawings and paintings. 
The execution varies from simple 
patterns composed mostly of squares 
to clever and original ones. 
Buildings were made by 21% of the 
total group. Of these, houses alone 
were made by 11% most of whom 
were males. Of the three girls who 
made houses alone, two were rated 
as maladjusted while on the third we 
had no follow-up information. Two 
of the houses incorporated bizarre 
features; of these one was made by a 
poorly adjusted male and the other 
by a girl on whom we have no rating. 
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TABLE III. Classification of Patterns 


Percentage of Subjects 


Classification Description Male Female Total 


I. Representational 


A. Kite The subject in moving about pieces at 0.8 0.8 
random or in combining single pieces 

makes a new form which pleases him. 

When this occurs, he is struck by a re- 

semblance between what he has made 

and some familiar object—e.g. in the 

simplest form, the “kite” made by 2 tri- 

angles. 


B. Direct Rep- 
resentation (self-explanatory) 
Il. Abstract 

A. Patterns with 


Abstract pattern where attempt is made 
recurring form 


for symmetry and definite shape. 


1. center Where such a pattern is placed well 


within the tray. 


2. edge Where such a pattern is placed in rela- 


tion to the edge of the tray. 


3. whole 
tray 


4. Collective 
Patterns 


Where the pattern is related to the edge 
and the whole tray is used. 


Where several small patterns are made 
but not considered as forming a single 
design. 


B. Patterns with- 
out recurring 
form 


Where symmetry and definite shape are 
not the aim of the subject. In this group 
the attitude and intentions of the sub- 
ject must be known to the examiner. 


1. designed 
slab 


Where a pattern of a slab* nature has 
been deliberately constructed and is con- 
sidered pleasing and successful by maker 
and critics. 


2. whole 
tray 


Where the whole of the tray is used in 1.6 0.8 2.4 
“free” and asymmetrical fashion. 


(*slab is defined by Lowenfeld as a number of pieces placed closely or loosely in juxtaposi- 
tion to each other without creation of overall symmetrical shape) 


Houses as part of a scene were made 
by 4% of the entire group, all girls 
and all making average or better ad- 
justments. Buildings other than hous- 
es were made by 6%, mostly males. 
Two were made by poorly adjusted 
boys—one, “a prison wall”, by a boy 
who is now on probation for robbery 
and the other, “a front of a garage”, 
by a boy who has since been involved 
in car stealing. 

Flowers alone were made by 8%. 
In Europe this is found to be a dis- 
tinctly feminine pattern. However, 
we found that two of our ten were 


made by boys, One boy who is now 
making an average adjustment made 
a series of flowers which were dis- 
tinctly experimental in quality; an- 
other very bright boy on whom we 
have no follow-up data was, at the 
time, living alone with his mother, a 
French widow employed in domestic 
service. 

Airplanes and space ships were 
made by 6% of the group. With one 
exception all were made by males. 
The girl made a space ship attacking 
the earth in a destructive, aggressive 
way. It is interesting to note that she 
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had originally attempted a house. At 
that time she was known to be having 
difficulty in her social relationships. 

Human beings were made by 5% 
of the group. Children were depicted 
only by girls while adults were por- 
trayed by boys. The only subject of 
this group who is now making a poor 
adjustment is a girl who made a 
family with strong phallic features. 

Animals were made by 2%, a boy 
and a girl. The boy had originally at- 
tempted a boat but was dissatisfied 
with it. Both children are presently 
well adjusted. The animals were clev- 
erly executed and showed motion. 

Scenes were made by 10%. With 
the exception of one, a “primary 
system” scene, all were made by chil- 
dren of superior intelligence. Two 
impressionistic scenes (mosaics used 
as paint) were made by very well ad- 
justed children. 

Miscellaneous objects were made 

by 15°, of the group with twice as 
many boys as girls in this category 
which included fireplaces, _ flags, 
checkerboards, etc. Two patterns rep- 
resenting natural forces (lightning, 
atoms) were made by superior chil- 
dren. 
Abstract patterns were made by 32% 
of the group: 20% boys and 12% 
girls.Patterns with recurring form— 
(i.e. where symmetry was attempted) 
were made by 28%, of the total group. 
Roughly half of these were center 
patterns, the other half were almost 
evenly divided among edge patterns, 
collective patterns and whole tray 
patterns. 

Of the centered symmetrical pat- 
terns, only three were unsuccessful; 
all made by males. Of these, one was 
killed in an automobile “accident”; 
one is making an adequate adjust- 
ment; one is delinquent. The pattern 
made by the last boy was striking — 
entirely yellow, distorted, heavy, un- 
pleasant, and anthropomorphic. 

The patterns indicating perspective 
were all made by bright children. 

Of the edge patterns, only one was 


unsuccessful and this was made by a 
now delinquent boy. Again, this pat- 
tern stood out because of its unpleas- 
ant quality. It grew diagonally from 
the corner and was made in the form 
of bold red and white stripes—thrust- 
ing and destructive. Half the edge 
patterns were frame and item rather 
than the simple edge patterns one 
gets in a younger group. 

Of the patterns covering the tray, 
one out of the four was made by a 
delinquent. It was a successful, com- 
pact design with nothing outstand- 
ing about it. 

Patterns without recurring form 
were made by only 4% of our group. 
The only slab patterns were made by 
delinquents. These are the type Dr. 
Lowenfeld has described as designed 
slabs since they were deliberately 
constructed and were considered 
pleasing both by the maker and crit- 
ics. Compact and free patterns using 
the whole tray were made by adjusted 
children. 


CONCLUSIONS 
Developmental Trends 


In comparing this early adolescent 
group with 100 six year olds we notice 
the following differences: 

1. A greater tendency toward ab- 
stract designs (33.3% as com- 
pared with 20%). 

The use of perspective. Lowen- 

feld reports this trend as begin- 

ning at about the age of twelve. 

It may indicate the early adoles- 

cent’s capacity for maturing, in- 

cluding his greater awareness 
and his capacity for abstraction. 

3. Almost complete disappearance 
of the “kite” response (in the 
one case found, it was produced 
by a maladjusted child.) 

4. Almost complete disappearance 
of “primary system thinking”. 
(In our only example, the child 
was generally considered imma- 
ture and inadequate). 

5. The appearance of the cruciform 
and winged patterns which Low- 
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enfeld believes indicative of the 
emotional turmoil of this age 
level. 

6. A change in the selection of type 
of representational pattern by 
the bright, adjusted youngster. 
In our 6 year old group, these 
children were more apt to make 
miscellaneous objects while in 
our present study, “scenes” were 
almost entirely the production of 
the bright, adjusted boy and girl. 


Sex differences 


Since the boys outnumbered the 
girls in our study, the following find- 
ings are based on the ratio of boys or 
girls making a specific design to the 
total number of the same sex. 

1. Flowers are represented by girls 
proportionately ten times as 
often as by boys, indicating per- 
haps the greater narcissism of 
the adolescent girl. 

2. A proportionately greater num- 
ber of girls depicted “human be- 
ings” and only the female sex 
constructed “children” with their 
mosaics. This might postulate a 
greater interest in human and 
family relationships on the part 
of the female at this age. 

3. Airplanes are the dominant mas- 
culine choice, indicating perhaps 
the greater interest of the male 
in “objects” as compared with 
“personal relationships” and also 
expressing a greater amount of 
aggression. 

4. Houses by themselves are made 
proportionately by three times 
as many boys as girls; other 
buildings, by a slightly larger 
percentage of boys; but, houses 
“as parts of scenes”, only by 
girls. One might speculate that 
the tendency of the adolescent 
female to embellish her houses 
by the addition of trees, flowers, 
sky, etc. is again the expression 
of her narcissism, her body- 
awareness, One might also spec- 
ulate that the far greater number 
of houses made by boys might in- 


dicate a stronger dependency of 
the male at this age on the home 
or at least, more feeling about 
growing away from the home. 

5. Abstract designs are depicted 
equally by both sexes but with 
the following difference: almost 
twice as many boys as girls made 
edge patterns while a slightly 
higher proportion of girls made 
centered patterns. This again 
might point to the greater ma- 
turity of the female at this age. 


Intelligence 


As we reported in a previous study, 
intelligence plays no dominant role 
in the production of a mosaic pat- 
tern. However, the following may be 
noted: the brighter child, who is ad- 
justed, has more ideas as well as the 
ability and freedom to integrate 
them. For example, “scenes” were al- 
most exclusively depicted by bright, 
adjusted youngsters. Almost all of 
our abstract patterns showing per- 
spective were also made by bright 
children. On the other hand, the 
“kite” pattern at this age level is in- 
dicative of some emotional difficulty 
rather than an intellectual defect. 


Predictive Value 


In order to predict future adjust- 
ment from the mosaic pattern, more 
than one design from a given subject 
is necessary. However, among our 14 
maladjusted youngsters the follow- 
ing features may be noted: | “kite” 
pattern; 2 age-inadequate representa- 
tionals; 1 bizarre; 1 dysphoric; 2 
ugly and unsuccessful; 2 highly sex- 
ual; 2 “slabs”. Of the remainder, | 
was mediocre in quality while 2 were 
well executed and seemingly “‘nor- 
mal”, 

Our “slab” patterns were construc- 
ted only by maladjusted youngsters 
which is in accord with Dr. Lowen- 
feld’s experience although not with 
some of our own previous findings. 
However, it must be remembered 
that our sampling of this type is ex- 
tremely small. 





Mosaic Patterns of Eighth Grade Children 


Movement was indicated by 11°, 
of our group. Strong, downward 
plunging movement, even in an ab- 
stract design, seems indicative of 
stress. When this movement was with- 
out form, seemingly with no intellec- 
tual control, the subject later showed 
problems of adjustment. When the 
movement was strong but not down- 
ward, the child later showed no seri- 
ous difficulty and was apt to be a 
bright youngster. 


In interpreting mosaic patterns, it 
is generally agreed that representa- 
tionals can be understood in the same 
terms as drawings and _ painting. 
However, abstract patterns frequently 
reveal feeling tones and qualities 
which can only be discerned by the 
worker who has had a great deal of 
experience with mosaics. Changes in 
the patterns during its production 
must also be noted since the final 


emergent design seems frequently to 
be an expression of deeper, uncon- 
scious motivation. For example, sev- 


eral of our children began with 
rather banal, conventional patterns 
but changed to others which seemed 
more indicative of what we knew to 
be at the time areas of conflict. One 
girl began to depict a house but 
changed it into a bolt of lightning. 
A bright youngster, she was at that 
period quite disturbed by her father’s 
pronouncement that she would be 
unable to take the college entrance 
course in high school since she was 
a girl and therefore “only good” for 
motherhood. Another girl who 
changed a conventional house to a 
space ship attacking the earth, was 
at the time having a good deal of 
difficulty in her social adjustment. 
Both of these youngsters, under 
stress, turned from the more passive 
pattern to the more aggressive, de- 
structive type. A boy, who first at- 
tempted a boat moving forward, 
changed to a “cute” penguin while 
another, from a racing car to a rab- 
bit jumping. Both of these boys were 
having some adjustment problems 


during this period, One would specu- 
late from the mosaics that the girls 
mentioned were attempting to solve 
their difficulties in a more aggressive 
way while the boys were adopting a 
more passive role. 


Cultural Differences 


In both our 6 year old and our 
early adolescent group, the American 
child makes significantly more repre- 
sentational patterns than the Eng- 
lish. As the American grows older, 
however, there is a tendency to draw 
somewhat closer to the English pat- 
tern. Although the English young- 
ster at this age level apparently aims 
at symmetry in both form and color 
of design (Lowenfeld reports 82.6°, 
successful designs), the American 
child seems satisfied and even pleased 
with asymmetry and apparently 
feels no need to execute his pattern 
“perfectly”. In our previous study of 
a group of 13 to 18 year old children, 
our “successful symmetricals” totalled 
23.6% while in the present study, 
37.5%. In other words, the American 
youngster seems less inclined. to fit 
into a set pattern, seems less con- 
cerned with the detail necessary for a 
painstaking performance, and is more 
interested in “things” in the world 
about him than the English child. 


SUMMARY 


A study was made of the mosaic 
patterns of 125 eighth grade children, 
falling in the early adolescent age 
group. We continue to find a pre- 
dominance of representational as op- 
posed to abstract designs, with hous- 
es and buildings constituting the ma- 
jor sub-classification. However, we 
note at this age a greater tendency 
to abstract designs than found previ- 
ously; the appearance of the cruci- 
form and winged pattern; the use of 
perspective; and, among _ brighter 
children, the ability to integrate ideas 
on a high level. Definite sex differ- 
ences were found as well as cultural 
differences between the Americans 
and English. The mosaic also proved 





our 
ican 
pre- 
eng- 
der, 
raw 
pat- 
ing- 
LimMs 
olor 
6°, 
ican 
ased 
tly 
tern 
y of 
ren, 
lled 
idy, 
ican 
. fit 
con- 
or a 
ore 
orld 


UrsULA STEWART, LORRAINE LELAND AND EDITH STRIETER 79 


to be of predictive value in the hands 
of a skilled worker. 
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Productivity as a Variable in TAT Protocols — A Methodological Study 


LEONARD P. ULLMANN AND RoBeErt L.. McFARLAND! 
VA Hospital, Palo Alto, California and VA Research Hospital, Chicago, Illinois 


While the TAT has proved to be 
a useful set of stimuli for personality 
research, studies of the TAT as a 
clinical tool have pointed toward 
practical and theoretical difficulties 
(2, 9, 10, 15). It has become increas- 
ingly clear that the TAT, like other 
psychological tests, is not “valid,” but 
valid under particular circumstances 
for specific tasks. The concepts and 
procedures for establishing the use- 
fulness of projective techniques is still 
a matter of debate (6, 7, 13, 17, 18). 


At the most general level, the task 
of the clinician in evaluating the 
data gained in projective interviews 
is that of describing the behavior of 
the subject in terms of some extra- 
test variable which is either qualita- 
tively or quantitatively expressed. 
Typically, as Hammond (7) points 
out, the operations of the clinician 
are not separated from the data with 
whieh he deals. The null hypothesis 
in research studies of the validity of 
projective devices has been set to date 
at chance or zero relationship. No con- 
sideration is taken of the amount of 
test material from any given patient 
with which the clinician has to work, 
and it is implicitly assumed that all 
protocols of a given device are of 
equal usefulness. In practice, however, 
the clinician is aware that there are 
barren protocols, and that with dif- 
ferent patients the responses to a pro- 
jective test may range from the cru- 
cial to the immaterial. Murray (16) 
provides a correction factor and notes 


1 We wish to acknowledge our thanks to the 

Manager and Research Committee of VA 
Hospital, Palo Alto, California, who made 
this study possible; to Ben C. Finney, who 
kindly provided us unpublished data on, 
and guidance in, the use of his Palo Alto 
Group Therapy Scale; and to S, Dean, D. 
Shannon, G. Brackbill, J. Taylor, and 
Nancy Robinson, who served as raters. 


a minimum number of words as a re- 

uirement of validity in the use of 
the TAT with college students. Eron 
and his co-workers (4) have devised 
rating scales for the evaluation of the 
intensity of feeling produced in a 
TAT story. In a similar manner, 
Weisskopf (21) has pointed out the 
utility of evaluating what the patient 
puts into the protocol. 


Productivity of the patient in the 
test situation will be considered in 
this study as a piece of information 
which may differentiate subjects in 
terms of a criterion. The empirical 
data consists of two quantifications of 
patients’ productivity on the TAT 
contrasted with global judgments by 
clinicians of the same protocols in re- 
lation to an explicit criterion. The 
criterion to be predicted will be ade- 
quacy of interpersonal relationships 
as measured by the Palo Alto Group 
Therapy Scale (GTS), (5). Two scores 
of productivity employed here will be 
the number of words per picture and 
the number of emotional words per 
picture made in TAT responses, The 
selection of these variables as_per- 
tinent measures of the amount of pro- 
tocol material stems from: (1) the 
consideration that they are among 
the most easily quantified basic aspects 
of the response made to the TAT sit- 
uation; (2) the evidence of Ror- 
schach_ studies that productivity 
underlies many of the further derived 
scores (11, 22); and, (3) the theoreti- 
cal contention that the ability to com- 
municate, indicated by both quantity 
of verbalization and emotional ex- 
pressiveness, is related to social ade- 
quacy. 

The specific hypotheses to be tested 
are that: (1)productivity, as measured 
by the number of words per TAT pic- 
ture, is related to interpersonal ade- 
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quacy as measured by the Palo Alto 
Group Therapy~Seale (GTS); (2) 
emotional expressiveness, as measured 
by the number of emotional words 
per TAT picture, is related to inter- 
personal adequacy as measured by the 
GTS; (3) the number of words and 
the number of emotional words per 
TAT picture are related to ‘obel 
predictions of the GTS made by clin- 
icians using the TAT; and, (4) since 
supposedly the judgmental manipula- 
tions of the clinician add significantly 
to the validity of the test process, rat- 
ings by clinicians will be related to 
the measure of interpersonal adequacy 
to a significantly greater extent than 
either measure of the amount of ma- 
terial in the protocol. 


METHOD AND PROCEDURE 


The specific data to be presented in- 
cludes a description of the criterion 
to be used, of the two samples of TAT 
protocols, of the task and reliability 
of the clinicians and of the two quan- 
tified scores of TAT material. 


The\Criterion. Finney (5) has pub- 
lished a method for rating patients’ 
behavior in therapy groups called the 
Palo Alto Group Therapy Scale. This 
measure was built around the vari- 
able of adequacy of interpersonal re- 
lationships as manifested in the group 
therapy situation. The scale consists 
of 88 items, each of which differenti- 
ates at the .01 level between the up- 
per, middle and lower thirds of group 
members as rated by therapists on the 
variable of interpersonal adequacy. 
The rater reliability is .90. Using 18 
therapy groups in a neuropsychiatric 
hospital, the median rank order cor- 
relation of scores on the scale with 
global ratings by group leaders was 
84. In a further validation study 
within the hospital setting, the aver- 
age rating of 10 ward personnel, as 
to adequacy of interpersonal relation- 
ships as manifested throughout the 
hospital, related .80 with ratings 
made by group leaders on the GTS. 
The GTS was used as a criterion in 


this study because it is a reliable 
method of quantifying those cues 
which are the basis of judgments of 
socially adequate behavior, and _be- 
cause it has demonstrated empirical 
validity within the scomeneiaes 
hospital. Beyond these considerations, 
behavior in a therapeutic situation 
and adequacy of interpersonal rela- 
tionships are factors about which the 
clinician frequently makes decisions 
from test protocols. 

The Samples. Two samples of TAT 
protocols were used. The first sam- 
ple, called the standard administra- 
tion sample, included 60 TAT pro- 
tocols administered within two weeks 
before or after a GTS rating. Testing 
was done an average of 2.5 days be- 
fore the criterion rating with a stand- 
ard deviation of 5.0 days. This sam- 
ple was collected by one examiner 
using standard instructions and in- 
quiry. Six cards were used: numbers 
4, 6BM, 7BM, 13MF, 15 and 17BM. 

A second group of protocols was 
collected to test further the relation- 
ships found with the standard admin- 
istration sample. Forty-six TAT pro- 
tocols administered by 23 examiners 
as part of routine psychological ex- 
aminations form the representative 
administration sample. These TATs 
were administered from 117 days be- 
fore to 94 days after the GTS rating. 
The median time of administration 
was 14.5 days before the criterion rat- 
ing, the average being 24 days before 
the rating with a standard deviation 
of 32 days. The number of TAT cards 
used ranged from 5 to 20, the 
median number being 9.6, the aver- 
age 9.7 with a standard deviation of 
3.0 cards. In over half the cases, cards 
1, 2, 3BM, 4, 6BM, 12M and 13MF 
were used. The instructions to the 
patient, type and number of inquiry 
questions, number and choice of the 
cards and method of recording the 
— responses were not uniform 
rom examiner to examiner. 

Global Judgments of the TAT. Five 
clinicians predicted GTS ratings from 
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the TAT protocols. These clinicians 
had had considerable experience with 
the TAT in neuropsychiatric veteran 
hospitals and were familiar with the 
criterion measure, With the standard 
administration sample, one clinician 
predicted the scores of the GTS rat- 
ing for the 60 cases. Two other clin- 
icians rank ordered one-third of the 
cases with regard to the criterion 
variable. The rank order correlations 
among the three clinicians on these 
20 cases were: .76, .71 and .68. The 
other two clinicians were assigned the 
task of dividing the 46 cases of the 
representative administration sample 
into high and low on adequacy of in- 
terpersona] relationships as measured 
by the GTS. The two raters agreed on 
the placement of 35 of the 46 cases, 
yielding a chi-square significant be- 
yond the .001 level. 

Scores uf the Amount of TAT Re- 
sponse Material. The two measures 
of the subject’s productivity in the 
TAT situation were the average num- 
ber of words and the average number 
of emotional words per TAT picture 
response. The number of words was 
the number of all the words recorded 
by the examiner as the subject’s re- 
sponse to the card. Words which ex- 
pressed how the subject felt about the 
test, exclamations, comments to the 
examiner, etc., if recorded by the ex- 
aminer as part of the responses, were 
included in this score. No reliability 
estimate was made for the number of 
words per picture since it was a direct 
counting procedure utilizing a mini- 
mum of judgment. 

The second productivity score was 
the number of emotional words per 
picture. As with the number of words 
per picture score, comments and ex- 
clamations made to the examiner 
were included in the word count 
along with the purely story-oriented 
verbalizations. Using 20 cases from 
the more homogeneous standard ad- 
ministration sample, rater reliability 
of emotional words per picture yield- 
ed a product moment correlation of 
.92 and a rank order correlation of 


.94. The material defining emotional 
words which was used was presented 
in terms of general, specific and ex- 
ample definitions and is as follows: 

General definition: Words with a special 
“punch” to them, which convey tension, 
action, or feeling, which breathe life into 
communication. 

Specific definition: Nouns which deal 
with interpersonal relationships of a ten- 
sional nature, such as competition, hope, 
approval, trouble, strength, sanity, argu- 
ment, decision, problem. 

Verbs which deal with human tensions 
or motivations, such as strive, plead, hang, 
restore, try, wonder, love, lose, regret, en- 
dure, must, want, stare, frustrate, 

Modifiers, either single words, or groups 
of words counted as one emotional word, 
which tell of the human condition beyond 
the overtly descriptive. Such words as extra 
kick, reached the end, cheer up, wrong, be- 
wildered, daze, strained, willful, rash, im 
pulsive, cool, going too far, tense, de- 
pressed and decisive are emotional words. 
Words which are descriptive of the stimuli 
such as young, old, male, female, mother 
and son (for 6BM), graveyard (for 15) are 
not emotional words. 

Words which are not in any of the above 
categories, but which communicate emo- 
tion. Exclamations such as “heck with her,” 
“this is hard,” or “like me fixing to leave 
home” are examples. Unusual or unex- 
pected combinations of words which are 
expressive and are not due to the subject's 
inattention to stimuli, such as holy pro- 
tector, side of sympathy, but it has been 
done, are examples. 

Example definition: 17BM: . . . He seems 
like he’s afraid of sliding down the rope. 
He doesn’t seem very happy about the situ- 
ation. (more?) No, I don’t have too much. 
(happen?) No, it doesn’t seem too much to 
describe here. (score is 2) 

4: ... Well, this picture seems, this first 
seems upset and she seems to be trying to 
talk to him, and he seems to be very angr) 
about the situation. (what sort?) No, I see 
another woman in the background. I don't 
know if they quarrelled or not. He looks 
like he’s in a kind of daze. He doesn’t want 
to talk about it, whatever it is. (score is 6) 


RESULTS 
The Standard Administration Sam- 
ple. Table I presents the product mo- 


ment correlations between the group 
therapy scale (GTS), the TAT global 
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rating (GR), the number of emotion- 
al words per picture (EW) and the 
number of words per picture (#W) 
for the 60 protocols of the standard 
administration sample. In the second 
section of the table, the critical ratios 
of ‘the correlations are presented. 


TABLE I*—Intercorrelations and Criti- 
cal Ratios of Amount of Material, 
(EW and #W), Global Ratings 
(GR) and Palo Alto Group Ther- 
apy (GTS) Scores for TAT Proto- 
cols of 60 Patients at a V.A. Neuro- 
psychiatric Hospital 


* A discussion of the selection of patients for 
group therapy by use of test measures may 
be found in Ullmann (20). 


Hypothesis 1, that the number of 
words per picture is related to the 
criterion, GTS, is substantiated be- 
yond the .01 level of statistical sig- 
nificance. Hypothesis 2 is also sub- 
stantiated, as the number of emo- 
tional words per picture is related be- 
yond the .001 level of statistical sig- 
nificance to the GTS criterion. Hy- 
pothesis 3, that the two measures of 
amount of material are related to 
global ratings of the protocols in 
terms of the GTS criterion is also 
upheld, the correlations being statis- 
tically significant beyond the .001 
level. Hypothesis 4, that the global 
rater would demonstrate greater val- 
idity than the single isolated variable 
of amount of material is not clearly 
demonstrated. When the number of 
words per picture is compared with 
the clinical judgment of the global 
rater, the significance of the difference 
between the correlated correlations 
yields a t ratio of 1.68, significant at 
the .10 level of statistical significance. 
The ¢ ratio of the difference between 
the correlations of number of emo- 
tional words and the global ratings 
to the criterion is 0.61, the difference 


being in the expected direction but 
not statistically significant. 


The Representative Administration 
Sample. To check the relationships 
obtained with the standard adminis- 
tration sample under conditions 
which were closer to the daily clinical 
setting, the four hypotheses were test- 
ed on the data of the representative 
administration sample. Skewed dis- 
tributions due to differences among 
examiners in test administration and 
protocol recording were found for the 
scores of the amount of material. For 
this reason, biserial correlation with 
the GTS as the graduated variable 
was used throughout work with this 
second sample. 


Hypothesis 1, that there is a posi- 
tive relationship between the average 
number of words per picture and the 
GTS criterion is upheld. The biserial 
correlation ‘between the average num- 
ber of words per picture and the GTS 
for the 46 cases of this sample is .30, 
significant at the .05 level of statistical 
significance (one-tail test). Hypothesis 
2 is also supported by the finding of 
a predicted significant positive rela- 
tionship: the biserial correlation be- 
tween the average number of emo- 
tional words per picture and the GTS 
is .40, significant beyond the .025 level 
(one-tail test). 

Two clinicians sorted the 46 TAT 
protocols of the representative ad- 
ministration sample as to probably 
high or low on the GTS. The first of 
these clinicians, R-1, had a chi-square 
relationship of 7.05 with the average 
number of words per picture, and a 
chi-square of 2.17 with the average 
number of emotional words per pic- 
ture. The judgments of the second 
global rater of this sample, R-2, had 
a chi-square relationship of 5.58 with 
both the average number of words 
and the average number of emotion- 
al words per picture. These results 
indicate that hypothesis 3 holds up, 
and that amount of protocol material 
is related to global judgments of TAT 
protocols as to interpersonal relation- 
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ships. On the representative adminis- 
tration sample, the number of words 
per TAT picture is significantly re- 
lated to the ratings of both clinicians, 
while the number of emotional words 
per TAT picture is significantly re- 
lated to ratings of one of the clin- 
icians, and shows a trend relationship 
with the other. 

The fourth hypothesis was that the 
global evaluation of TAT protocols 
will be more valid in relation to a 
criterion than will single isolated 
cues such as the variable of amount 
of material. The first clinician, R-1, 
obtained a biserial correlation of .14 
with the GTS criterion. This rela- 
tionship is not significantly better 
than » ol and is of a lower mag- 
nitude than either of the measures of 
amount of material. The second glo- 
bal rater of the representative admin- 
istration sauiple, R-2, obtained a bi- 
serial correlation of .50 with the GTS 
criterion. For the 46 cases of this 
sample, this relationship is significant 
at the .01 level of statistical signifi- 
cance. Because biserial correlation 
was used, the test of significance of 
difference between the correlated cor- 
relations was done by comparing the 
number of cases correctly placed 
when the clinician and the measure 
of amount of material were in dis- 
agreement (12). 

Table Il presents the chi-square 
relationships, after Yates correction 
had been applied, for the number of 
hits and misses of the global rater, 
GR, of the standard administration 
sample, and the two raters of the rep- 
resentative administration sample. 
The chi-squares are positive if the 
clinicians placed more protocols cor- 


Tas._e II—Chi-square Relationships 
After Yates Correction: Comparison 
of Clinicians and Scores of Amount 
of Material in Correctly Identify- 
ing Ratings on GTS 


EW 
—0.28 
—2.72 
—1.06 





rectly than the measures of amount of 
material, and negative if the measures 
of amount of material placed more 
protocols correctly in terms of the 
criterion. 

Table Il indicates that as far as an 
increased number of correctly placed 
protocols in terms of the GTS cri- 
terion, hypothesis 4 is not substanti- 
ated by the performance of any of 
the clinicians. Rather, there is a 
trend in favor of the measures of 
amount of material. Such results were 
to be expected with clinician, R-1, 
who did less well than either of the 
measures of amount of material, but 
were not expected in relation to GR 
and R-1 who obtained higher correla- 
tions than the scores of amount of 
material. While these findings might 
lead to interesting speculations, the 
lack of clear statistical relationships 
in the present results makes it im- 
possible to reject the null hypothesis 
for hypothesis 4 under the conditions 
of the present experiment. 


DISCUSSION 


Within the limits of the patients 
and the clinicians used in this study, 
information regarding the relative 
amount of material produced on the 
TAT may be considered a useful in- 
dication of the criterion of interper- 
sonal adequacy as manifested in the 
group situation. In the present study, 
the further manipulations of the pro- 
tocol material by the clinicians did 
not add significantly to the informa- 
tion obtained from the score of the 
amount of material. This finding is of 
a preliminary nature and limited to 
a small sample of clinicians. How- 
ever, it suggests that quantified meas- 
ures of productivity can serve as one 
possible baseline for the evaluation 
of the clinician’s usefulness. It may be 
argued that the relationship of the 
amount of material to a criterion pro- 
vides a more realistic baseline for the 
evaluation of the clinician’s global 
impressions than a null hypothesis of 
chance relationship. The scorés of the 
amount of material which were de- 
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rived in this study also may have 
value in studying what sart of stimuli 
are tikely to produce responses-which 
are“ clinically useful. Eron (3) has 
pointed out the differences in num- 
ber and type of thema produced in 
response to various TAT cards, and 
it seems reasonable to hypothesize 
that the usefulness of TAT cards (1, 
8, 19) is related to the relative amount 
of material verbalized in the average 
response. With the method _intro- 
duced here, it is possible to measure 
productivity first and correlates in the 
stimuli second. 

The method of measuring produc- 
tivity by the use of the average num- 
ber of emotional words per card re- 
sponse was formulated in our hypoth- 
eses as a score of emotional expres- 
siveness. In dealing with studies of 
clinical usefulness, then, the number 
of emotional words may help in de- 
termining the part played by expres- 
sion of emotion in clinical evalua- 
tion. More refined analysis may show 
that the relationship of clinicians’ 
judgments and the number of emo- 
tional words differ due to the vari- 
able of appropriateness of the _pa- 
tient’s use of the material. 

Having the clinician make con- 
scious use of the predictive usefulness 
of the productivity variables immedi- 
ately occurred to us. The rater, GR, 
was provided with the productivity 
scores (#:W, EW), the TAT proto- 
cols from the representative sample, 
the predicted criterion scores (based 
on the relationship between amount 
of material and the GTS (1) and 
again asked to make _ predictions 
of the GTS scores. While his global 
ratings on the standard administra- 
tive sample data correlated at .58, in 
this second instance, the correlation 
fell to zero. In retrospect, it would 
appear necessary to set a “permissible 
range of change” for the predicted 
criterion score (from any quantified 
measure) to safeguard the amount of 
variance already accounted for by the 
relationship between the predictor 
variable and the criterion. One other 


consideration seemingly should be 
noted, It appears from inspection of 
our data that all the raters could pre- 
dict more readily scores on both ex- 
tremes of the criterion scale than 
those scores in the middle range. This 
possibly suggests that the clinician 
should not “tamper” with the mid- 
range scores where he is likely to be 
penalized for his lack of reliability 
but should feel freer to change scores 
that are at the extremes of the pro- 
ductivity continuum. Empirical test- 
ing of these notions is obviously 
needed. 

The present results lead to a final 
hypothesis about the functioning of 
the clinician; in our formulations of 
he "Wkcly velisionshin. between _num- 
ber of €motional words and the GTS 
criterion, we made a prediction which 
essentially stated that a patient who 
was more productive in the test situ- 
ation would be more likely to be of 
greater productivity in the group sit- 
uation. This position is similar to 
some of the formulationsof the clin- 
ician’s role of Meehl (14). In short,-we 
specified a behavior which could be 
extrapolated from one situation to an- 
other. Where test and criterion be- 
havior aré maximally similar, there 
is little room or need for the accum- 
ulated experience and knowledge of 
theory which distinguishes the clini- 
cian from the automaton. It may be 
hypothesized that as the relationship 
between the test sample of behavior 
and criterion, or the criterion itself, 
becomes an increasingly theoretical 
one, the clinician’s ability to trans- 
cend the protocol material increases. 





SUMMARY 


The purpose of this research was to 
demonstrate the value of conceiving 
the amount of material produced by 
the subject on the TAT as informa- 
tion which can be considered, prior 
to, and separate from, the manipula- 
tion of protocol data by the clinician. 
The amount of material produced by 
the subject was treated as a piece of 
information which has validity in re- 
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lation to a criterion and which can be 
related to global judgments of that 
criterion by clinicians, Finally, the re- 
lationship of the amount of material 
to the criterion was suggested as a 
more realistic baseline for evaluating 
validity of clinicians’ manipulation of 
material than the customary baseline 
of chance relationship. 


~_To demonstrate these ideas, the 


average number of words and the 
average number of emotional words 
per TAT card for two samples of VA 
neuropsychiatric patients were relat- 
ed to ratings of the subjects on the 
Palo Alto Group Therapy Scale, a 
measure of adequacy of interpersonal 
relationships. Independent estimates 
of the group therapy scale ratings 
were made from the TAT protocols 
by skilled clinicians. The first sam- 
ple consisted of 60 protocols admin- 
istcred in a standard fashion by one 
examiner. The second sample con- 
sisted of protocols of 46 patients 
which had been administered by 23 
examiners as part of routine psy- 
chological examinations, These data 
served as a check on the results of 
the first sample by providing an esti- 
mate of the obtained relationships 
under typical clinical conditions. The 
relationships obtained indicate that 
measures of the amount of TAT ma- 
terial are related to the criterion of 
adequacy of interpersonal relation- 
ships as manifested in group therapy 
and to ratings from the TAT by 
clinicians of this criterion. There was 
no indication that the clinicians in 
this sample predicted the present cri- 
terion significantly better than the 
score of the amount of material pro- 
duced by the subjects. 

Implications of the results were dis- 
cussed in terms of providing a method 
for measuring the amount of material 
produced in response to projective 
stimuli, and in terms of ascertaining 
how this material may best be used. 
It was hypothesized that the clinical 
usefulness of projective stimuli is re- 
lated to the amount of material like- 
ly to be produced by subjects. It was 


further hypothesized that a clinician 
is most likely to transcend the proto- 
col data when he has (1) sufficient ma- 
terial with which to work and (2) is 
predicting a complex criterion for 
which there is no direct extrapolation 
from the test data or situation. 
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An Experimental Investigation of ‘‘Label-Avoidance”’ 
as a Manifestation of Repression’ 


EpiTH WEIsskoPF-JOELSON, E. J. ASHER, AND KENNETH J. ALBRECHT 
Purdue University 


MarTIN L. HOFFMAN 
Merrill-Palmer School 


The present study was stimulated 
by Tomkins’ (5) discussion of re- 
moteness and its use in the measure- 
ment of repression. The concepts 
used here, however, differ somewhat 
from those originated by Tomkins. 

External stimuli can be conceived 
to vary on a continuum with respect 
to the degree of association with cer- 
tain impulses. For example, a scant- 
ily dressed woman in an alluring po- 
sition is more closely associated with 
the sex impulse than a plainly dressed 
woman working at a desk. This is 
just another way of saying that in 
most people, the former stimulus will 
arouse the sexual impulse to a higher 
degree than the latter. The hypothe- 
sis of this study can be loosely stated 
as follows: to the extent that an im- 
pulse is repressed, its expression in 
response to a stimulus tends to be 
“inappropriate” in terms of the de- 
gree of association of the stimulus 
with the impulse. That is, a strongly 
repressed impulse is less likely to find 
expression when the situation calls 
for it than when the situation does 
not call for it. 

This hypothesis can be illustrated 
by various clinical observations: a 
man with strong repressions in the 
erotic area may not express erotic 
feelings in such erotic situations as 
dancing and dating, yet he may ex- 
press them quite spontaneously in 
situations associated with work or 
sports. A neurotic who has difficulty 


‘A part of this paper is based on a thesis pre- 
sented to the Graduate School of Purdue 
University, Lafayette, Indiana, by K. 
Albrecht in partial fulfillment of the re- 
quirements for a M.S. degree in psychology. 
The study was directed by E. Weisskopf- 
Joelson and FE. J. Asher, 


experiencing enjoyment may not be 
able to enjoy situations ordinarily 
seen as pleasurable, e.g., vacations, 
parties, etc., but he may be able to 
gain pleasure from situations that 
ostensibly were not designed for this 
purpose. 

The TAT responses of subjects 
with strongly repressed sexual or ag- 
gressive impulses might serve as an- 
other example. Such subjects fre- 
quently fail to tell sexual or aggres- 
sive stories in response to pictures 
having obvious sexual or aggressive 
content; instead, they tell such stories 
in response to pictures that are not 
normally asociated with these im- 
pulses. 


In this paper stimuli that are close- 
ly associated with a given impulse are 
characterized as “carrying the label of 
that impulse”. Thus, a date with 
someone of the opposite sex contains 
a combination of stimuli carrying 
the label “eroticism”. Similarly, a 
TAT picture showing a boy with a 
gun carries the label “aggression”. 
However, to carry the label of an im- 
pulse is undoubtedly a matter of de- 
gree. Our hypothesis could thus be 
restated loosely as follows: people 
who strongly repress an impuise tend 
to avoid expressing this impulse in 
situations carrying its label to a high 
degree. The mechanism under exam- 
ination, then, can be called “label- 
avoidance’”’. 

The resemblance between _label- 
avoidance and displacement is im- 
mediately apparent. There is an im- 
portant difference, however. In dis- 
placement the object of the impulse 
is changed, while in label-avoidance 
the same impulse is expressed towards 








a oem £2 


be 
rily 
ons, 
» to 
hat 
this 


ects 
ag- 
an- 
fre- 
res- 
res 
ive 
ries 
not 
im- 


»le 
nd 


gh 
m- 
el- 


el- 
m- 
m- 


Ise 
ce 
ds 














WEISSKOPF-JOELSON, ASHER, ALBRECHT AND HOFFMAN 89 


the same object under different cir- 
cumstances. For example, if the im- 
pulse of aggression against a parent 
were subjected to displacement, it 
might be redirected towards a person 
different from the parent. If the same 
impulse were subjected to label- 
avoidance, aggression against the 
parent would be expressed under cir- 
cumstances where it is inappropriate 
or unexpected. 

Why should subjects characterized 
by strong repression of an impulse 
find it easier to express the impulse 
in situations that do not carry the 
label of the impulse to a high de- 
gree? A possible explanation is as 
follows: Stimuli that are closely as- 
sociated with an impulse tend to 
arouse it to a higher degree than 
stimuli that are only slightly associ- 
ated with it. On the other hand, the 
more strongly an unacceptable im- 
pulse is aroused, the stronger should 
be the defenses that are mobilized 
against its expression. Therefore, the 
defenses can be expected to decrease 
with decreasing association of the 
stimulus with the unacceptable im- 
pulse. Applying Miller’s (4) theory 
of displacement to label-avoidance, 
we assume here that the strength of 
the defenses falls off more steeply 
with decreasing association of the 
stimulus with the impulse than does 
the strength of the unacceptable im- 
pulse. Following Miller, an increase 
in the strength of the defenses (e.g. 
of repression) should thus shift the 
expression of the impulse in the di- 
rection of stimuli that are less strong- 
ly associated with it (see 4, p. 168). 

In more animistic language, label- 
avoidance may be seen as a deception 
of the censor. Whereas the censoring 
agencies of the ego are put on the 
alert by such “dangerous” labels as 
“sex” or “aggression”, their vigilance 
is relaxed when the situation is 
labeled “‘harmless”’. 

It is the purpose of this study to 
suggest measures of label-avoidance 
and to test the hypothesis about the 


relationship between repression and 
label-avoidance. If stimuli are ar- 
ranged on a continuum from low to 
high as to the degree of association 
with aggression against a parent, 
these stimuli may be used to test the 
hypothesis of this study: subjects 
with strong repression of aggression 
toward a parent will tend to express 
aggression in response to stimuli that 
are lower on the continuum than the 
stimuli that elicit expression of ag- 
gression from subjects with relatively 
weak repression. 


METHOD 


Subjects 

The subjects were 113 male high 
school students ranging from 13 to 
17 years of age?. Members of minority 
groups were not included because of 
the difficulties involved in comparing 
their F scale scores with those of the 
majority group. 


Measures of repressed aggression 
toward parents 


The findings reported in the Auth- 
oritarian Personality (1) indicate 
that repressed aggression against the 
parents is one of the central charac- 
teristics of high scorers on the F scale. 
Accordingly, high scores on a modi- 
fied and abbreviated version of the F 
scale were used as one of the indicat- 
ors of repressed aggression. This scale 
consisted of 18 items — 15 items from 
the F scale, some of which were un- 
changed from the original and some 
which had been reworded by Horton 
(3) for use with high schoo] students, 
and three items originated by Horton 
and included in his Fascism scale for 
high school students. The items chos- 
en from the original F scale and 
from Horton’s revision were those 
which seemed to have most relevance 
to parental aggression and to be most 


* The authors wish to express their apprecia- 
tion to the Superintendent of the Indian- 
apolis Public Schools and to the Staff of 
Arsenal Technical High School for their as- 
sistance in conducting the experiment. 
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appropriate for high schoo] students. 
We shall refer to the total score on 
these 18 items as the F score. 

A scale measuring conformity val- 
ues was used as the second measure 
of repression of parental aggression. 
The rationale for using this scale was 
based on Hoffman’s (2) findings that 
high conformists tend to show a rela- 
tively high degree of repression of 
aggression against their parents. The 
Conformity scale consisted of 14 
items such as “if we don’t fit into a 
group we should try to change our- 
selves until we do fit.” Five of these 
items were taken from Hoffman’s 
study and reworded for high school 
students and nine were developed 
especially for this study. We shall re- 
fer to the total score on this scale as 
the C score. 

Both tests permitted four response 
choices for each item: “agree”, “un- 
decided; probably agree”, “undecid- 
ed; probably disagree’, and “dis- 
agree’. These responses were scored 
1, 2, 3, 4, respectively, or 4, 3, 2, 1, 
depending on the direction of the 
statement. 


Measure of label-avoidance 


Label-avoidance was measured with 
a projective technique developed by 
Weisskopf - Joelson. The materials 
consist of a series of 15 pictures. Each 
picture depicts an older and a young- 
er man who are perceived as father 
and son by most subjects. The sub- 
jects were asked to tell a story about 
each picture. The pictures were 
planned in such a manner that each 
one permits the subject to tell either 
a story in which the son attacks the 
father or a “harmless” story without 
overt aggression. For example, one 
picture shows father and son seated 
at a dinner table. The son is holding 
a large knife which is pointed in the 
father’s direction but also held above 
a roasted turkey. This picture is 
drawn in such a manner that it could 
be interpreted either as the son be- 
ing about to attack the father or 
about to carve the turkey without, in 





either case, doing injustice to the ob. 
jective stimulus. The pictures ranged 
from scenes that elicit aggressive 
stories from almost al] subjects to 
scenes that rarely elicit such stories. 
That is, the pictures vary on a con- 
tinuum of the extent to which they 
carry the label of aggression against 
the father. Thus, label-avoidance 
would be manifested by not telling 
aggressive stories to the pictures that 
normally evoke aggressive stories and 
telling aggressive stories to the pic- 
tures at the other end of the series. 


For purposes of establishing norms 
the data obtained from two groups 
of high school students were used. 
One group consisted of the 113 high 
school students who served as sub- 
jects for the present study and the 
other consisted of 74 high school stu- 
dents used in a preliminary investi- 
gation of the label-avoidance meas- 
ure. For each picture the number of 
stories in which the son behaves in 
a physically aggressive manner to- 
ward the father was obtained. Scor- 
ing was done by Albrecht in accord- 
ance with a set of scoring rules. In 
order to check reliability, Weisskopf- 
Joelson scored 100 randomly selected 
stories. The agreement between the 
two scorers was 96 per cent. The pic- 
tures were ranked in the order of in- 
creasing number of aggression — 
against—father stories elicited by 
them.* 

The degree to which a given sub- 
ject tends to tell aggressive stories to 
non-aggressive pictures and vice versa 
was ascertained by three measures. 

1. The number of aggressive stories 
told to Pictures 1, 2, and 3. Since 
Pictures 1, 2, and 3 carry the label 
of aggression to a lesser degree than 
the other pictures, the number of 
aggressive stories told to these pic- 
tures can be used as a measure of one 


* The correlation between the picture rank- 
ings found separately for the two sub- 
samples of the norm group is .91. Therefore, 
it seemed justifiable to combine the two 
groups. 
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aspect of label-avoidance, namely of 
the tendency to tell aggressive stories 
to non-aggressive pictures. The first 
three pictures were selected as a basis 
for this measure because there is a 
sharp breaking point after Picture 3 
in the number of aggressive stories 
told to each picture. 

2. The number of aggressive stories 
told to Pictures 13, 14, and 15. Since 
Pictures 13, 14, and 15 carry the label 
of aggression to a higher degree than 
the other pictures, the number of ag- 
gressive stories told to these pictures 
can be used as a measure of one as- 
pect of label-avoidance, namely of 
the tendency to avoid telling aggres- 
sive stories to pictures with obviously 
high aggressive content. 

3. The average aggression score. 
Each picture was given a_ weight 
roughly proportional to the frequen- 
cy of aggressive responses it elicited 
from the norm group. These weights 
were used as a quantitative measure 
of each picture’s position on the 
“normative scale” ranging from Pic- 
ture 1 to Picture 15. Subjects who 
tend to tell aggressive stories to pic- 
tures with low weights would tend to 
show high deviation from _ the 
“norm,” ie. high label-avoidance. 
The average aggression score was 
computed for each subject by adding 
the weights of the pictures to which 
aggressive stories were told and by 
dividing the sum by the total number 
of aggressive stories told by the sub- 
ject. Thus, the average aggression 
score of each subject measures rough- 
ly the amount of deviation from the 
“norm” per aggressive story told. 


Procedure 


All tests were administered in one 
session, with the picture test preced- 
ing the two questionnaires. A book- 
let was distributed to each subject in 
the beginning of the session, with 
fifteen empty sheets for the fifteen 
stories of the picture test, followed by 
the mimeographed questionnaires. 
The pictures were presented to the 
subjects one at a time by projection 


on a screen. The instructions were 
identical with those suggested by 
Murray for the TAT except that the 
subjects were requested to write their 
stories. Three minutes were allowed 
for each story. The pictures were 
presented in a gradually increasing 
order of aggressive labeling, i.e., the 
first picture presented (No. 1) was 
the one least likely to elicit stories 
of attack and the last picture (No. 
15) the one most likely to elicit such 
stories. This order was used to mini- 
mize carry-over effects from the more 
highly aggressively labeled pictures 
to the pictures less so labeled.* A 
brief intermission was introduced 
after the picture test. The subjects 
were not requested to give their 
names. 


ANALYSIS AND RESULTS 


It was predicted that Measure | of 
label-avoidance would be positively 
related to the F scores obtained on 
the modified scale and to the C 
scores obtained on the Conformity 
scale, and that Measures 2 and 3 
would be negatively related to these 
scores. 


The subjects were divided into 
four groups according to their F 
scores and C scores, namely F+ C+ 
(subjects above the median on both 
F scores and C scores), F+ C— (sub- 
jects above the median on F scores 
and below the median on C scores), 
F— C+, F— C-—. These four groups 
did not differ significantly from each 
other as to the average number of 
aggressive stories told to all pictures. 
This preliminary finding appears to 
supply a further justification of 
Measures | and 2 of label-avoidance. 
Since the four groups of subjects do 
not differ as to the average number of 


‘ The order was determined by a preliminary 
experiment in which the same pictures were 
administered to a similar group of subjects. 
The authors wish to express their apprecia- 
tion to Dr. Homer Wood and to the Staff of 
Jefferson High School, Lafayette, Indiana, 
for their cooperation in conducting this ex- 
periment. 
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aggressive stories, any differences in 
the number of stories told to Pictures 
1, 2, and 3 or to Pictures 13, 14, and 
15 are more likely to be a function 
of the distribution of aggressive 
stories on the “normative scale” of 
pictures than of differences in the 
average number of aggressive stories. 

All of the possible pairs among the 
four groups of subjects were com- 
pared as to their scores on the three 
measures of label-avoidance, by 
means of chi square, with conting- 
ency tables dichotomizing each group 
at the median score on each measure. 
In comparing the relative frequency 
of responses to Pictures 1, 2, and 3 
(Measure 1) in the C+ groups, the 
hypothesis of no association was re- 
jected. Subjects in the C+ F+ 
group tended to make more aggres- 
sive responses than did subjects in 
the C+ F— group (see Table I).* In 


Taste I—Comparison of the C+ 
F+ group with the C+ F— group 
as to Measure | of label-avoidance 
(the number of aggressive stories 
told to Pictures t, 2, and 3). 


Frequency C+ F4 C+ F— 
Above median............ 12 4 
Below median.............. ; 21 21 

X? = 4.63 


P between .02 and .05 


a similar test using the average ag- 
gression score (Measure 3), the hy- 
pothesis of no association was reject- 
ed in the C+ groups. Subjects in the 
C+ F-+ group tended to have higher 
average aggression scores than sub- 
jects in the C+ F— group (see Table 
Il). The other comparisons did not 
show any association of Measures 1, 
2, or 3 with C scores or F scores, 


DISCUSSION 


The tests using Measures | and 3 
lend some support to the hypothesis 
that label-avoidance is related to re- 
pression of aggression against the 


5 An analysis of variance supported the re- 
sults obtained by means of chi-square, 


TasLE IIl—Comparison of the C+ 
F+ group with the C+ F— group 
as to Measure 3 of label-avoidance 
(the average aggression score). 


Frequency C+ F+ C+ F— 
Above median................ 10 1+ 
Below median................ 23 9 

X? = 4.54 


P between .02 and .05 


father. The tests using Measure 2 do 
not support this hypothesis. 


Among the subjects with C scores 
above the median, high F scores are 
associated with high label-avoidance 
as measured by Measures | and 3. 
Since F scores and C scores are cor- 
related,® it can be expected that the 
C+ F+ group has higher C scores 
than the C+ F— group. This expec- 
tation was corroborated at the .01 
level. Thus, the difference in label- 
avoidance between C+ F+ and C+ 
F— may be due to variation in C 
scores alone and/or to an interaction 
between F scores and C scores. If the 
former is the case, it might indicate 
that low label-avoidance (i.e. low re- 
pression of aggression) is associated 
with conformity scores in the median 
range, namely in the lower half of 
the C+ group rather than with low 
conformity scores. This assumption 
is supported by the fact that the C+ 
group and the C— group did not dif- 
fer significantly from each other as 
to any one of the measures of label- 
avoidance. The following considera- 
tions make such results plausible: 
Clinical observation as well as Hoff- 
man’s (2) study suggest that many 
non-conformists may be people who 
use reaction-formation against high 
conformity; thus, they might show 
closer psychological resemblance to 
the high conformists than the sub- 
jects in the middle range of con- 
formity. 


Perhaps the positive as well as the 


*When both scales are split at the median 
and the resulting 2x2 contingency table is 
analyzed by means of chi square, the rela- 
tionship is significant at the 5 per cent level. 
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negative results of the comparisons 
with respect to Measures | and 3 can 
be explained as follows: Subjects with 
extremely high C scores show more 
label-avoidance than subjects with 
moderate C scores. The F scores show 
no observable relationship to label- 
avoidance, except to the extent that 
they correlate with the C scores. A 
positive relationship between C 
scores and label-avoidance and an ab- 
sence of such relationship between F 
scores and label-avoidance could be 
clinically explained as follows: The 
high conformity scorers might be 
conceived as people who repress ag- 
gression against the father, and who 
have found no outlet for the re- 
pressed impulse. If the threat of such 
aggression is decreased by label-re- 
moval, it is possible for the aggression 
to be expressed. The high F scorers, 
on the other hand, are people who 
have diverted their repressed par- 
ental aggression into other channels. 
Thus, the release of pressure within 
the original channel through label- 
removal might less likely result in 
expression. 

Measure 2, the number of aggres- 
sive stories told about Pictures 13, 14 
and 15, does not show any relation- 
ship to label-avoidance. Only further 
research can determine whether this 
negative finding necessitates a modi- 
fication in the hypothesis or whether 
it is an artifact of the present experi- 
mental design. Several subjects’ com- 
ments in their stories to the most ag- 
gressive pictures suggest that these 
pictures are very obvious in their ag- 
gressive content and that failure to 
tell aggressive stories might often re- 
sult from the conscious attempt “not 
to fall into the examiner’s trap” 
rather than from unconscious repres- 
sion. Moreover, since the two groups 
of subjects (C+ F+ and C+ F—) 
are equal as to the average number of 
aggressive stories and as to the num- 
ber of aggressive stories told to Pic- 
tures 13, 14, and 15, and since the 
C+ F+ group exceeds the C+ F— 
group as to the number of aggressive 





stories told to Pictures 1, 2, and 3, it 
can be concluded that the C+ F— 
group exceeds the C+ F+ group as 
to the number of aggressive stories 
told to Pictures 4 to 12.7 Such con- 
siderations and the positive result 
obtained with Measure 3 indicate 
that the findings of the study are in 
agreement with the hypothesis that 
repression of aggression correlates 
with both aspects of label-avoidance, 
namely with the tendency to tell ag- 
gressive stories to relatively non-ag- 
gressive pictures and to tell non-ag- 
gressive stories to relatively aggres- 
sive pictures. 

In conclusion, the findings of the 
present study lend some support to 
the hypothesis that people who re- 
press their aggression against the 
father to an extreme degree tend to 
express this aggression in “inappro- 
priate” rather than in “appropriate” 
situations, i.e. they tend to use label- 
avoidance as defined in this paper. 
The study also indicates that the con- 
cept of label-avoidance might prove 
useful in the application of pictorial 
projective techniques. Further refine- 
ments may make it possible to use 
the degree of deviation as a measure 
of the degree of repression, not only 
with respect to aggression, but also 
with various other impulses. 
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™ These pictures are too close together on 
“the normative scale” to warrant a further 
subdivision into two groups of pictures. 








Relationships between Specific Rorschach Variables 
and Sociometric Data’ 


Rita R. WERTHEIMER 
Western Psychiatric Institute, University of Pittsburgh 


Recent attempts at validation of 
specific Rorschach factors have fre- 
quently yielded inconclusive and con- 
troversial results, particularly when 
overt behavior has been used as a 
validation criterion. The present in- 
vestigation represents an attempt to 
use the overt behavior characteristics 
associated with high and low socio- 
metric status for validation purposes. 
Jennings (5) has reported extensively 
on adolescent behavior characteristics 
associated with acceptance and rejec- 
tion. These characteristics were ob- 
tained from direct behavioral obser- 
vation. Jennings found that adoles- 
cents who were over-chosen by their 
peers in sociometric choice situations 
and who were considered as enjoying 
better than average social acceptance 
had a number of common personality 
attributes. High sociometric status 
adolescents could widen the social 
field for the participation of others by 
ingratiating them into activities, in- 
troducing new activities, and by fost- 
ering tolerance on the part of one 
member toward another. The socially 
accepted were also able to succeed in 
controlling their moods, at least to 
the extent of not inflicting negative 
feelings of depression or anxiety on 
others. They were able to establish 
rapport quickly and effectively with 
a wide range of other personalities 
and to win their confidence. The so- 
cially accepted appeared to possess to 
a greater or less degree an unusual ca- 
pacity to identify with others to the 
extent of feeling solicitude for them. 
In contrast, the socially dejected adol- 





1 This paper represents a portion of the dis- 
sertation presented in partial fulfillment of 
the requirements for the Ph.D. at the Univ- 
ersity of Pittsburgh. It was read at the Mid- 
western Psychological Association meetings 
in Chicago in 1953. 


escents appeared to be “self-bound” 
in terms of personality attributes, and 
were relatively unable to bridge the 
gap between their own personalities 
and those of other people. It seemed 
that at least certain of these personal- 
ity characteristics found more fre- 
quently in the socially accepted adol- 
escents could be used to test the val- 
idity of the hypotheses underlying a 
few selected Rorschach factors. 


PRESENT PROBLEM 


The present study is an attempt to 
compare selected Rorschach factors 
with behavior characteristics found 
by Jennings to be associated more 
frequently with socially accepted ad- 
olescents than with socially rejected 
ones. If the hypotheses underlying 
these Rorschach variables are tenable, 
there should be a significantly great- 
er incidence of these variables in the 
socially accepted group. 

Specific Rorschach variables which 
purport to give evidence on the hypo- 
thetical personality variables which 
are associated with social acceptance 
include: 

a. social identification (shown in 
the Rorschach variable “human 
response percentage”) or H%; 

b. trends toward social conformity 
(shown in the Rorschach vari- 
able ‘popular response percent- 
age’) or PY; 

c. control of emotionality (shown 
in the Rorschach by an excess of 
form-color responses over color- 
form responses) or FC > CF; 

d. “tact” (shown in the Rorschach 
differentiated Fc response); 

e. “extratension” (shown in the 
Rorschach by a greater response 
to color rather than to move- 
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ment responses in the M:C ratio) 
or SC>M. 


SUBJECTS AND METHODOLOGY 


Initially a near-sociometric ques- 
tionnaire was constructed and admin- 
istered to nearly all of the tenth, elev- 
enth, and twelfth grade students in 
two high schools. The subjects were 
asked to name three students in their 
home room groups as preferred com- 
panions in each of three sociometric 
choice situations. The questions were 
confined to the general area of leisure- 
time activities since high sociometric 
choice status may vary with different 
kinds of criterion situations, An ex- 
ample of the questions is: “Suppose 
you are planning a party at your 
home and have to limit the number 
of people you can ask to it. Which 
three members of your home room 
class would you invite?” 

A roster of each home room class 
was obtained and a frequency tabu- 
lation made of the number of times 
each member was chosen by any 
other member as a companion for any 
or all of the criterion situations. Each 
person obtained a total sociometric 
choice frequency. 

To evaluate the statistical signifi- 
cance of this frequency, Bronfen- 
brenner’s (3) deviation from chance 
expectancy approach was used. In 
terms of his formulation (in which 
account is taken of the skewness as- 
sociated with sociometric distribu- 
tions), for statistical significance at 
the .05 level in the present situation 
where three choices were given on 
three criteria, the total number of 
choices needed for assignment to the 
accepted group was fifteen and above, 
while three or fewer choices were 
necessary for the rejected position. 

From the original group, 98 socially 
accepted and 102 socially rejected 
adolescents who received significantly 
high or significantly low sociometric 
scores were chosen. The socially ac- 
ceptel and rejected groups were 


equated for sex, age, grade, intelli- 


gence, and prestige level of father’s 
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occupation. Porter's (8) occupational 
rating scale specifically adapted for 
occupations frequently found in the 
Pittsburgh area was used. In this 
scale, the distribution of occupations 
was converted into stanines, with 
a stanine of one considered as a low 
prestige level and nine as a high one, 
Operationally those occupations that 
received stanine ratings of one to 
three were categorized into the low 
socioeconomic level, those that re- 
ceived ratings of four and five in the 
middle level, while those that received 
stanine ratings of six to nine were 
classified in the high socioeconomic 
level. Table I presents relevant data 
on the subjects used in the study. 

The group Rorschach was adminis- 
tered, following the Harrower-Erick- 
son and Steiner (4) procedure gener- 
ally, but with certain minor adapta- 
tions made necessary for adequate use 
with this high school group. 

The Rorschach protocols were 
scored by a combination of Klopfer 
(6) and Beck (2) procedures. To eval- 
uate Rorschach scoring accuracy, 
twenty protocols were independently 
rescored by another psychologist using 
the same scoring schedule, When the 
number of responses scored the same 
was divided by the total number of 
responses scored, the agreement be- 
tween scorers was 90 percent. 


TREATMENT OF THE DATA 
AND RESULTS 


The specific Rorschach variables 
were dichotomized at the median in 
the case of (a) HY and (b) P°®,. In 
the case of (c) FC greater than CF, 
(d) Fc responses and (e) a greater 
response to color in the M:C ratio, 
the dichotomy was in terms of pres- 
ence or absence of the attribute. Chi- 
square, following Snedecor (9), was 
applied to the resultant frequencies. 
These are shown in Table II. 

The hypotheses presented in this 
study were not found valid. None of 
the chi-squares is significant at the 
05 level of confidence. Since it is 
known that the occurrence of the 
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Specific Rorschach Variables and Sociometric Data 


Tas_e I. Data Showing the Classification of Subjects in Terms of 
Sociometric Status, Sex, and Socioeconomic Level and the 
Equation of Subgroups on Age, Grade, and Intelligence. 


Low Middle High 
Socioeconomic Socioeconomic Socioeconomic 
Level Level Level 
Groups: N Mean N Mean N Mean Totals 
Male Accepted 
Age (months)................. 12 202 24 202 11 202 47 
Grade (years). anes 10.9 10.9 10.6 
| eee 103 104 103 
Male Rejected 
Age (months)................. 16 202 19 202 17 201 52 
Grade (years)................- 10.9 10.8 10.8 
BO (Otia)......................-... 104 103 105 
Female Accepted 
Age (months).................. 18 202 17 201 16 200 51 
Grade (years)............. * 10.9 10.8 10.6 
Le 103 104 103 
Female Rejected 
Age (months)................. 20 202 16 202 14 203 50 
Grade (years) : 11.0 10.8 11.0 
2) eee 103 104 103 
_ a 76 58 200 
TABLE II. Chi-Square Values For the Incidence of 
Specific Rorschach Variables* 
Rorschach Factor Chi- 
Groups or Sign Dichotomy Square 
Accepted versus rejected.......................:.. Human Response Median 19 
Percentage 19.98 
Popular Response Median 01 
Percentage 23.42 
FC greater than presence or 59 
CF absence 
Fc presence or 78 
absence 
Extratension presence or 1.65 
absence 
Number of Median OB 
Responses 29.94 


* A chi-square of 3.841 is required for significance at .05 level of confidence, and 6.635 at the 


01 level, with one degree of freedom. 


specific Rorschach variables investi- 
gated in this study is at least partly 
a function of the number of responses 
(R), this response variable was dich- 
otomized at the median, and its rela- 
tionship to social acceptance was 
evaluated by chi-square. As shown 
in Table II, the obtained chi-square 
was not statistically significant. 


CONCLUSIONS 


In terms of the present research, 


no significant relationships were 


found between certain Rorschach 
variables and social acceptance by 
others. The specific Rorschach vari- 
ables were tested against the external 
criteria of overt behavioral character- 
istics rather than against other test 
data. As evidenced here, the adoles- 
cents with high social acceptance by 
their peers did not differ in terms of 
social identification, trends toward 
social conformity, in the control of 
emotionality, in “tact” or in “‘extra- 
tension”. While the socially accept- 
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ed exhibited these attributes more 
frequently in behavioral character- 
istics, the specific Rorschach factors 
which purportedly give evidence on 
social identification, trends toward 
social conformity, etc., did not occur 
with greater frequency in the socially 
accepted group. The results of this 
study do suggest that clinical interpre- 
tations resting on the mechanical ap- 
plication of the hypotheses underly- 
ing the investigated Rorschach vari- 
ables can only be made tenuously. 
The personality characteristics that 
have been attributed to adolescents 
who have a high degree of social ac- 
ceptance by their peers may reflect 
the higher level of emotional growth 
and maturity of this group, and a 
relatively greater freedom from per- 
sonal and social problems and general 
self-concern. Research with paper and 
pencil questionnaires and problem 
inventories by Baron (1) and Kuhlen 
and Bretsch (7) for example substan- 
tiates this point of view. Additional 
Rorschach research with a small num- 
ber of cases from both the accepted 
and rejected groups may throw addi- 
tional light on this problem, particu- 
larly if global clinical evaluations of 
personal and social] adjustment were 
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made from the Rorschach data. 
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Krout, Maurice H., Ed. Psychology, 
Psychiatry and the Public Interest. 
Minneapolis: Univ. of Minn. Press, 
1956, pp. vii + 216. 


This is a timely book, just as Hunt’s “The 
Clinical Psychologist” is timely. Their ob- 
jective is peace. There has never been a pe- 
riod when tensions between psychiatrists and 
psychologists were so acute and when the 
public interest stood to suffer so much as a 
result. This compilation of papers devotes 
more attention to the disputed issues between 
the two professional groups than to the ex- 
amination of the public interest, a kind of 
preoccupation which is one of the unfortu- 
nate consequences of hostility. In Part IV, 
however, the welfare of the public comes in 
for some direct consideration, and actually it 
is implicit in much of the other content. 

Dr. Krout has assembled here statements 
from thirteen psychologists and one psychi- 
atrist, a few of them representing their pro- 
fession officially, more of them writing un- 
officially out of their own experience and 
reflections. In addition there are two “offi- 
cial” pronouncements. One is a statement by 
organized psychiatry, “Relations of Medicine 
and Psychology”; and the other is on “The 
role of the clinical psychologist as presently 
conceived by the Veterans’ Administration 
program.” The book is logically organized 
into four parts. The opening section defines 
the problem, the second gives the view of 
organized psychiatry, the third presents the 
ideas of individual psychologists who have 
worked closely with psychiatrists in the team 
situation, and the fourth gives expression to 
attitudes of “qualified” psychologists in 
private practice. The chapters for the most 
part are brief, and a clarifying statement of 
the “viewpoint” of the writer and a sum- 
mary of the chapter’s contents appear on the 
first page of each, It is a conveniently ar- 
ranged book. 

This volume would not be needed were it 
not for the recent increasing social accept- 
ance of psychotherapy. Social sanction has 
come in this country earlier than in Britain, 
where the prevailing attitude still is that 
the Briton “holds himself together” without 
benefit of professional help. The rise of the 
non-medical therapist in the United States 
and the relation of this rise to World War 
II are examined in the opening section, as 
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is the disturbance in identity that has de- 
veloped in both psychiatrists and_psychol- 
ogists as they find themselves “displaced per- 
sons” in this new therapeutic land concern- 
ing which there is as yet so little established 
knowledge. 

It is in Part If that the meat of the psy- 
chiatrists’ position is presented. The gist of 
it is a simple syllogism: 

1. The treatment of illness is a medical 


responsibility. 

2. Psychotherapy is a form of treatment of 
illness. 

3. Therefore, psychotherapy is a medical 
responsibility. 


It is the same old syllogism, coming down, 
as Dr. Huston says, “from ancient times.” It 
is rigid and unalterable. 

Although there are sharp differences in 
the levels at which the problems are exam- 
ined in the various papers, the psychologists’ 
treatment shows more variety, more freedom, 
more imagination than the _ psychiatrist's. 
Perhaps it is because they have more at 
stake. Or have they? In spite of considerable 
repetition, there are four points which stand 
out most vividly from the various contribu- 
tions. 

On one point there seems to be complete 
consensus, psychiatrists and psychologists 
alike: That there is good cooperation be- 
tween individual members of the two pro- 
fessions on the operating level. As Collier 
puts it: “There is usually a harmonious re- 
lationship between clinical psychologists and 
psychiatrists.” All the contributors agree on 
this, and certainly it is confirmed by the 
personal experience of many of us. “Some 
of our best friends are psychiatrists”, and 
vice versa. This curious dissociation between 
personal experience and official professional 
position suggests that there is at the moment 
a kind of straw man that has been set up 
to bear the formal brunt of our competitions 
and antagonisms. 

A second point on which there is agree- 
ment is that research is an acceptable activi- 
ty for the psychologist. As Dr. Huston puts 
it: “It is in the area of research that psy- 
chology, with its scientific attitude, can func- 
tion most productively.” Between the two 
professional groups there is a little differ- 
ent flavor in the approval of this research 
role. The psychiatrist’s applause has a little 
of the implication: “Research is O.K. for 
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these psychologists. It will keep them in 
their proper place, out of harm’s way, out 
of mischief, out of psychotherapy.” The psy- 
chologists’ acceptance of this responsibility 
has more of the meaning: “This psycho- 
therapy is such an unchartered business. 
What do we know about it? Why do some 
patients get better? Why do others not im- 
prove? How can we learn more about what 
all of us are doing and what is taking place 
in psychotherapy?” But in any case, both 
groups believe that research ought to be 
done and that more solid facts ought to 
be known. Some of the psychological con- 
tributors tend to play up psychology’s re- 
search accomplishments as greater than they 
have been up to the present. Rogers certain- 
ly has been tireless in his research activi- 
ties. But not many psychologists, especially 
those in private practice, are turning out 
significant research in psychotherapy. 

The third point is a well-taken question 
raised by Yacorzynski and by Schwartz: Since 
we have no knowledge of how psychotherapy 
works, how do we know who is qualified 
to do it? How do we know exactly what 
method of training is best? What basis is 
there for saying that everyone needs a medi- 
cal degree? They give the answer that we 
do not as yet know enough about the psy- 
chotherapeutic process to make dogmatic 
statements. The kind of evidence cited 
even for the effectiveness of a particular 
therapy is “no different from that offered by 
voodooism, yogaism, various religious cures, 
dianetics, Christian Science, and so on.” In 
other words, the patient says he feels better 
(or worse) and the therapist believes him. 

The last point is made with special force 
and clarity by Lindner and by May. It punc- 
tures the psychiatric syllogism. We are pay- 
ing a high: price, they argue, for a careless 
use of such labels as “sickness, illness, dis- 
ease”, thus encouraging the stereotype of 
the “medicine man”, the “healer”, the “mag- 
ician”. We know that “disease” consists of 
aberrant phenomena within individuals, 
while emotional and functional psychiatric 
disorders arise out of difficulties in the indi- 
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vidual’s relations to others or to himself. 
Even the tranquilizing drugs we use work 
on a different principle from those which 
destroy invading germs or viruses in organic 
illnesses. They merely block off the painful 
effects of an emotional state but do not 
affect its course. Treatment differs from that 
of a disease. Things are done not to the pa- 
tient, but with him, and in their doing he 
plays a major role. The last thing in the 
world we want in psychotherapy is for “the 
patient to be ‘patient’ as a sick person in 
the hospital is ‘patient’, calmly waiting for 
nature and the physician to perform the 
cure.” If everyone would stop referring to 
emotional disorders as if they were disease 
entities, the age-old psychiatric syllogism 
would be knocked into a cocked hat, We need 
a new frame of reference and a new vocabu- 
lary. Psychotherapy is not a curative pro- 
gram or regimen imposed by medical im- 
peratives. It is a process of learning. The 
patient is not “passive, plastic and compli- 
ant” as the physician would have him. He 
is an active participant. The interchange be- 
tween patient and therapist is dynamic, mu- 
tual, interactive. These are the concepts 
which need to be substituted for some of 
what Lindner called our “sloppy semantics”. 
Separate emotional disturbance and _ psycho- 
therapy from the stereotypes, and much of 
the fury of the professional battle will sub- 
side. 

This book is not only timely, but also 
useful, It clarifies many areas of agreement 
between the two professions. Everyone in 
both camps is “against sin” — that is, against 
the psychologists’ invasion of the domain of 
organic sickness, against incompetence, against 
inadequate training, against quackery. Ev- 
eryone verbally is for the patient. Add one 
more area of agreement — that everyone 
needs to learn more in theory and in prac- 
tice about the process of psychotherapy for 
emotionally troubled people — and _ there 
will be less of strife and more of loyalty to 
the public interest. 


RuTH S. TOLMAN 








GENERAL NEWSLETTER 


Roemer, Georg A. Observaciones 
sobre el Psicodiagnostico de Ror- 
schach. Revista de Psicologia general 
y aplicada, 1956, 11, 55-68. (Madrid) 

A theoretical discussion of the meaning of 
a variety of Rorschach variables. 


Leblanc, Maria. Adaptation Afri- 
caine et comparaison interculturelle 
d’une épreuve projective: Test de Ro- 
senzweig. Revue de Psychologie appli- 
quée, 1956, 6, 91-109. 

Responses of 245 African children to the 
Rosenzweig P-F Test are compared with 
American findings. Statistically significant dif- 
fercnees are presented. 


Pichot, P.; Freson, V.; and Danjon, 
S. Le Test de Frustration de Rosen- 
7weig (Forme pour enfants). Stand- 
ardisation et étalonnage de la version 
Francaise. Revue de Psychologie ap- 
pliquée, 1956, 6, 111-138. 

Age norms on the French adaptation of 
the children’s version of the Rosenzweig P-F 
Test with comparisons between French and 
American findings. 


Kadinsky, David. Zum Problem der 
Bewegungsdeutungen im Rorschach. 
Zeitschrift fiir diagnostische Psycholo- 
gie, 1956, 4, 218-237. 

A discussion of the three kinds of move- 
ment response found in the Rorschach, 


Zuberbier, Erika. Untersuchungen 
zur Konsistenz des graphischen Aus- 
drucks. Zeitschrift fiir diagnostische 
Psychologie, 1956, 4, 238-259. 

A study of individual consistency of expres- 
sive movements as measured by handwriting, 
drawing of a tree, and drawings of designs. 
Five significantly consistent variables were 
found. 


Canestrari, D.; and Minguzzi, G. F. 
“Z” Test e percezione sociale. Zeit- 
schrift fiir diagnostische Psychologie, 
1956, 4, 261-270. 


Differences between Z-Test and Rorschach 


results in a sample of 50 children’s records 
are found and explained. 


Ziolko, H. U. Farbpyramidentest- 
Untersuchungen bei Neurotikern. 
Zeitschrift fiir diagnostische Psycholo- 
gie, 1956, 4, 271-276. 

Color Pyramid Test performances of 35 fe- 
male neurotics show changes during therapy. 


Hiltmann, Hildegard; Henck, Hel- 
mut; and Stark, Heinz-Dietrich. Der 
Fall, “Friedrich”: hirnorganisch und 
seelisch bedingtes dissoziales Verhal- 
ten. Zeitschrift fiir diagnostische Psy- 
chologie, 1956, 4, 277-296. 

A case study of organic brain damage in 
an antisocial boy which utilizes the Color 
Pyramid Test, Z-Test, and TAT. 


L’Abate, Luciano. I] linguaggio del 
fanciullo attraverso una tecnica proi- 
ettiva. Bollettino di Psicologia e So- 
ciologia applicate, 1956, 13-16, 54-76. 
(Firenze). 

A study of children’s linguistic development 
by means of a projective test in which the 
child is presented a picture and selects an- 
other of a group of pictures which completes 
the idea, finally telling a story describing 
the sequence. 


Ferracuti, F. and Rizzo, G. B. Anal- 
isi del valore discriminativo di alcuni 
segni di omosessualita rilevabili attra- 
verso tecniche proiettive. Bollettino di 
Psicologia e Sociologia applicate, 1956, 
13-16, 128-134. (Firenze). 

Homosexual and heterosexual subjects are 
compared in their responses to the TAT, 
Rorschach, and human figure drawings. 


Ferracuti, F. and Rizzo, G. B. Esame 
comparativo dei fattori di siglatura 
al Rorschach ed al Test di Howard. 
Bollettino di Psicologia e Sociologia 
applicate, 1956, 13-16, 135-141. (Fir- 
enze). 

Rorschach and Howard Ink Blot perform- 
ances of 20 subjects are so different as to 
preclude comparability of findings. 





ANNOUNCEMENTS 


WORKSHOPS 


The Department of Psychology, University 
of Chicago, announces that Dr, S. J. Beck 
will be conducting his usual workshop in the 
Rorschach test, in the summer of 1957, the 
twenty-first consecutive year in which he is 
teaching these seminars. The first workshop, 
July 8-12, will be devoted to basic processes 
of the test and related problems. Principally, 
these are the scoring techniques and the 
methods for organizing the separate data 
into the whole personality construct. The 
second, July 15-19, will be devoted to ad- 
vanced clinical interpretation focusing on two 
varieties of cases: the ego in acute benign 
reactions in adults; thinking and perception 
in malignant psychological trends in children. 
Both these personality patterns will be 
demonstrated from Rorschach test pictures 
as obtained from patients in these clinical 
groups. 

For information, write to the Department 
of Psychology, University of Chicago, Chi- 
cago 37, Illinois. 

S. J. Beck 
University of Chicago 


Western Reserve University announces 
again three Rorschach Method Workshops 
which will be conducted by Marguerite R. 
Hertz, Associate Clinical Professor of Psy- 
chology,,in the 1957 Summer Session. Work- 
shops are open to qualified psychologists, 
psychiatrists, research workers, psychiatric 
social workers, counsellors, and graduate 
students in clinical psychology having at 
least one full academic year’s study or the 
equivalent. Persons in allied fields will be 
considered for acceptance on an individual 
basis. 

Workshop I. June 10-14 inclusive. Introduc- 
tion to the Rorschach Method 

This will consist of lectures on the admin- 

istration and scoring, oriented toward prin- 

ciples of interpretation. There will be 

demonstrations in the State Hospital and 
supervised training periods. 

Workshop II. June 17-21 inclusive. Jnter- 
mediate Seminar 

This will consist of intensive discussion of 

scoring, principles of interpretation, and 

meaning of individual scores and score con- 
figurations. The potentialities and limits 
of content interpretation will also be con- 


sidered with discussion of the major dyn- 
amics of the test situation and the inter- 
personal examiner-subject _ relationship. 
Rorschach records of normal children and 
adults as well as those presenting various 
types of disorders will be analyzed. There 
will also be demonstrations in the State 
Hospital. 

Workshop III. June 24-28 inclusive. Advanced 

Seminar 

This will consist of an advanced seminar 
in the dynamics of various clinical syn- 
dromes and the analysis of typical cases. 
Problems of differential diagnosis and re- 
search will be considered. There will also 
be intensive study of thematic interpreta- 
tion and further consideration of the 
extra-Rorschach variables in the Rorschach 
testing situation. 
Admission is limited to professional 
trained persons who have had at least one 
full year of experience with the Rorschach 
Method and who have attained some com- 
petence in its use. 
For each Workshop, there are all day ses- 

sions and one evening session. 


Each Workshop is limited to 20 persons. 

Dr. Hertz will conduct all seminars. 

The Fee is $44.00 per Workshop. 

One academic semester hour credit per 
Workshop will be given if desired upon reg- 
istration and presentation of transcript of 
college record. 

Application forms may be obtained from 
the Director of Admission, Western Reserve 
University, 2040 Adelbert Road, Cleveland 
6, Ohio. 

Applicants meeting the necessary require- 
ments will receive notification of acceptance. 
A list of rooms and restaurants which are 
available on the campus within walking dis- 
tance of the Psychology Building will be sent 
out one month prior to the Workshops. Res- 
ervations for living accommodations may be 
made in advance by writing directly to the 
names suggested on the list. 
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PROGRAM FOR ANNUAL MEETING 


The program committee of the Society has 
plans for a number of symposia which will 
comprise the program for the annual meet- 
ing in August. Consequently there will be no 
presentations of individual papers. 
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Announcements 


RESEARCH EXCHANGE 


This is going to be a new column in the 
Journal of Projective Techniques. Its pur- 
pose is to stimulate and expedite research in 
the area of projective diagnosis. 

There are many clinicians who have excel- 
lent research ideas and too little time to 
carry them out. Thus, valuable ideas are 
lost or delayed in their presentation to the 
profession. Possibly such persons could be 
helped to make their contributions to the 
field if they were provided space in this 
column to describe their ideas, Such descrip- 
tions would enable others with more time to 
carry out the research. In this way collabora- 
tion between those with ingenuity and expe- 
rience and those with time and less expe- 
rience might make significant contributions 
to the field as a whole. This column could 
become a source of dissertation projects for 
graduate students. 


In addition to the publication of research 
ideas the column could become an exchange 
for hard-to-get records, data, and control 
groups. For example, if someone needed for 
research purposes a sample of Rorschach of, 
let us say, cerebral palsied adolescents, he 
could put a “want-ad” in this column. On 
the other hand, if someone were in the pos- 
session of exceptionally interesting and rare 
data, he could advertise them here either for 
others’ use or for some collaborative effort 
with interested persons. 

We are now soliciting from interested read- 
ers the following kinds of communication for 
the next issue (deadline: May 1, 1957): (1) 
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descriptions of research ideas, (2) want-ads 
for rare records, (3) listings of rare records 
which might be lent to other psychologists, 
and (4) suggestions as to ways in which this 
column might be of service in facilitating re- 
search activities. 

EpITH WEIsSKOPF- JOELSON 

Psychology Dept. 

Purdue University 

Lafayette, Indiana 


Editorial Note: 

The growth of theories and the piling up 
of research evidence occur at different levels 
and at different rates of speed. The research 
attitude involves distrust of speculative extra- 
polations beyond the proven and accepts only 
(and often much too readily) concepts and 
relationships for which some empirical evi- 
dence is available. 

This point of view has the unfortunate 
effect of creating a time lag between the de- 
velopment of a potentially productive hypoth- 
esis and the communicated knowledge which 
it might have stimulated. Many fertile ideas 
are lost and delayed unnecessarily because 
creative thinking moves faster than research 
findings but is communicated more slowly. 

Dr. Weisskopf-Joelson has the Executive 
Editor’s blessing in her attempt to decrease 
the lag between ideas and findings in pro- 
jective research. We are prepared to allow 
her space for her column as long as it ap- 
pears to accomplish this purpose. 

Executive Editor 
BERTRAM R. FORER 
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FISCHER, Liselotte K.( Ph.D.) 
615 North Wolfe Street 
Baltimore 12, Md. A 1949 
FLEMMING, Edward L.(Ed.D.) 
10585 Lakeview Road East 


Jacksonville 11, Fla. A 1954 
FONT, Marion McKenzie 

627 S. Carrollton Ave. A 1942 

New Orleans 13, La. F 1947 


FORER, Bertram R.( Ph.D.) 
2170 Live Oak Drive E. A 1949 
Los Angeles 28, Calif. F 1951 
FORER, Lucille K.( Ph.D.) 
2170 Live Oak Drive E. 
Los Angeles 28, Calif. 
FORREST, Mrs. Carol W. 
55 West 11th Street 
New York, N. Y. A 1951 
FORTIER, Robert H. (Ph.D.) 
151 Locust Avenue 
Springfield, Pa. A 1956 
*FOSBERG, Irving A.( Ph.D.) 
1516 Arabella Street A 1940 
New Orleans 15, La. F 1949 
FOSTER, Austin( Ph.D.) 
The Psychopathic Hospital 
University of Texas 
Medical Branch A 1950 
Galveston, Texas F 1955 
FRAMO, James L., Jr.( Ph.D.) 
2130 MacLarie Lane 
Broomall, Pa. A 1955 


FRANCOEUR, Thomas A. 


A 1953 


1070 Crevier Avenue (Ph.D.) 

Ville St. Laurent 

Prov. Que., Canada Aff. 1954 
FRANK, Lawrence K. 

Ashland, N.H. H.M. 1954 


FRANKEL, Esther B.( Ph.D.) 
Child Guidance Clinic 
Children’s Hospital 
420-22 Cherry Street 
San Francisco 18, Cal. A 1953 


*FRANZETTI, Mrs. Rosa 


Padlina de 
“El Silencio’ Bloque 6-C-4 
Caracas, Venezuela A 1940 


FREAR, Edgar 


Montrose, Pa. A 1950 


FREY, Mrs. Harriet K. 
59 Francisco Avenue 
West Caldwell, N. 7. 

FRIEDMAN, Alice( Ph.D.) 
780 Madison Avenue 
New York 21, N. Y. A 1951 

FRIEDMAN, Mrs. Gladys Miller 
2860 Van Aken Blvd. 

Cleveland 20, Ohio A 1949 

FRIEDMAN, Howard ( Ph.D.) 
316 Southfield Drive 
Fayetteville, N. Y. A 1951 

FRIEDMAN, Ira( Ph.D.) 

2860 Van Aken Boulevard 

Cleveland 20, Ohio A 1954 
FRIEND, Mrs. Jeannette G. 

16 Greenough Circle 

Brookline 46, Mass. A 1949 

FRISCH, Paul Z. (Ph.D.) 
Psychology Department 
Adelphi College 
Garden City, N.Y. 

*FROMM, Erika O.(Pb.D.) 
5717 S. Kenwood 
Chicago 37, Ill. A 1940 

FROSTIG, Marianne (Ph.D.) 
1023 North Fairfax Avenue 
Los Angeles 46, Calif. A 1956 

FRY, Franklyn D. 

1724 Wyoming Avenue 
Forty Fort 
Wilkes-Barre, Pa. 

FRY, Mrs. Martha O. 
1724 Wvoming Avenue 
Forty Fort 
Wilkes-Barre, Pa. 

FUCHSMAN, Seymour H. 
288 Lexington Avenue 
New York 16, N.Y. 

GARDNER, Mrs. Ann K. 
2569 Berkshire Road 
Cleveland 6, Ohio 

GASOREK, Katbryn 
30 E. Elm Street 
Linden, N. J. 

GASTON, Charles O. 
University of Texas 
Medical Branch 
Galveston, Texas St. Aff. 1955 

*GAUDET, E. Louise( Ph.D.) 
210 W. 70th Street 
New York 23, N. Y. F 1940 

GAUDET, Frederick J.( Ph.D.) 

210 W. 70th Street 


A 1953 


F 1956 


A 1952 


A 1952 


A 1944 


A 1942 


A 1949 


New York 23, N. Y. A 1949 
GEIL, George A. 

915 Kings Avenue 

Springfield, Mo. A 1943 


*GERING, Mrs. Evelyn E. 
18063 Valley Vista Blvd. 
Encino, Calif. A 1940 
GERSTEN, Charles( Ph.D.) 
1821 Grandin Street S.W. 
Roanoke, Va. A 1949 
GETOFF, Louis 
251 West 89th Street 


New York 24, N.Y. A 1956 
GIBBY, Robert G.( Ph.D.) 
1220 Jeffras Avenue A 1954 


Marion, Ind. F 1955 
GILBERT, Raymond R. 
$2 Halifax Street 
Boston 30, Mass. 
GILLENSON, Gertrude N. 
See Brody, Gertrude G. (Ph.D.) 
GILLMAN, Mrs. Etta C. 
16 Stevenson Avenue 
Hartsdale, N. Y 
GLASS, Blanche (Ph.D.) 
Box W 
Newtown, Conn. 


A 1951 


A 1944 


A 1955 
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GOLDBERGER, Leo 

Research Center for 

Mental Health 

New York University 

21 Washington Place 

New York 3, N.Y. A 1956 
GOLDFARB, William(M.D.) 

530 West End Avenue A 1941 

New York 31, N. Y. F 1944 


GOLDSTEIN, Dr. Fred J. 
Pinel Foundation 
2318 Ballinger Way 


Seattle 55, Wash. A 1956 
GOLICK, Mrs. Margaret 
944 Dunlap Avenue A 1953 


Outremont, Quebec, Canada 


GONDOR, Mrs. Lily H. 

$20 East 57th Street A 1949 

New York 22, N. Y. F 1952 
GOODMAN, Harvey( Ph.D.) 

97 Cedarhurst Avenue 

Cedarhurst, N. Y. A 1954 
GOODMAN, Morris(Ph.D.) 

$ Wellington Road 

Livingston, N. J. A 1953 
GOODNICK, Benjamin (Ph.D.) 

Administration Building 

Parkway and 2Ist 

Philadelphia 3, Pa. A 1956 
GOOLISHIAN, Harold A.(Ph.D.) 

1008 Camp Circle West 

La Marque, Texas A 1952 
GORDON, Dr. Edward M. 

$9-A E. 72nd Street 

New York 21, N.Y. A 1955 
GORDON, Thelma 

307 W. llth — 

New York 14, N.Y. A 1951 
GOTTLIEB, ~ Sophie B. 

225 W. 86th Street 

New York 24, N. Y A 1943 
GRAHAM, Virginia T.(Ph.D.) 

General Hospital, N-3 z 

Cincinnati 29, Ohio A 1953 
GRASSI, Joseph R. 

Bowman-Gray School of Med. 

Wake Forest College 

Winston-Salem, N.C. <A 1942 
GRAVES, Winifred S.( Ph.D.) 

4242 Cornelius Ave. A 194 

Indianapolis 8, Ind. F 1951 


GRAVITZ, Melvin A. (Ph.D.) 
5014 Bradley Boulevard 
Chevy Chase 15, Md. A 1956 


GRAYSON, Harry M. 
12640 Oxnard Street — A 1951 
North Hollywood, Calif. 


GREENBERG, Nathan 
5447 Jeanne a Street 
Montreal, Quebec 
Canada . St. Aff. 1954 


GREENBERG, Pearl( Ph.D.) 
25 W. Henry Street 
Linden, N. J. A 1951 


GREENE, Janet S.(Ph.D.) 
65 E. 76th Street 
New York 21, N. Y. A 1953 


GREENSTADT, William M. 
35 E. 30th Street St. Aff. 1954 
New York, N. Y A 1955 


GRIER, Mary E. (Ph.D.) 
2910 Ludlow Road, #14 


Cleveland 20, Ohio A 1956 
ba ed = L.( Ph.D.) 

Us  ' Shipyard 

Pearl Harbor, T.H. A 1952 


GROSSMAN, Mrs. Marc J. 
16950 S. Woodland ry" 
Shaker Heights 20, O. A 1949 
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GROSSMAN, Searles A. ™, D.) 
23 Kensington Lane 51 
Brookside, Newark, Del. t 1954 

GUERTIN, Wilson H.( Ph.D.) 
Box 635 A 1950 


Perry Point, Md. F 1953 
GUINDON, Jeannine 

39 Ouest Gouin Blvd. 

Montreal, Que.,Can. A 1951 


GUNDLACH, Ralph( Ph.D.) 
162 East 80th Street 


New York 21, N.Y A 1951 
GUREVITZ, Saul( Ph.D.) 

680 West End Avenue 

New York 25, N. Y. A 1949 


GURVICH, Mrs. Bernice M. 
251 Willis Avenue 
Hawthorne, N. Y. A 1950 
GURVITZ, Milton S.( Ph.D.) 
108 Hampshire Road A 1948 
Great Neck, N. Y. F 1951 
GUY, William 
Springfield State Hospital 
Sykesville, Md. A 1953 
HABER, Wm. B.( Ph.D.) 
275 Central Park West 
New York 24, N. Y. A 1953 
HAINES, Miriam S.( Ph.D.) 
166 Morse Place 
Englewood, N. J. A 1951 
*HALLOW, William C.( Ph.D.) 
515 S. Fifth Avenue 
Lebanon, Pa. A 1940 
*HALLOWELL, A. Irving( Ph.D.) 
Box 14, Bennett Hall 
Univ. of Pennsylvania A 1940 
Philadelphia 4, Pa. F 1944 
HALLOWELL, Dorothy K 
3318 Midvale Avenue igre! 
Philadelphia 29, Pa. A 194 
HALPERIN, Sidney L.( Ph.D.) 
Paliiki Place 
Kaneohe, Hawaii A 1949 
HALPERN, Esther 
Mental Hygiene Institute 
531 Pine West 
Montreal, Canada St. Aff. 1954 
HAMMER, Emanuel F.( Ph.D.) 
685 West End Avenue 
New York 25, N. Y. A 1953 
ae Xe D, Mrs. Eleanor 
SS 


Now “Hope, Pa. A 1947 
HAND, Dr. Mary Ella 
432 Hamilton Place 
Ann Arbor, Mich. 
HANDEL, Gerald 
Social Research, Inc. 
145 East Ohio Street 
Chicago 11, Tl. A 1954 
HANFMANN, Eugenia(Ph.D.) 
c/o Dr. Helen Beier 


A 1948 


375 Harvard Street A 1948 

Cambridge, Mass. F 1950 
HARRIS, Albert J.( Ph.D.) 

Educational Clinic 

Queens College 

Flushing, N. Y. A 1951 


HARRIS, June 
Bureau of Child Guidance 
228 E. 57th a. 
New York 22, N A 1941 


HARRIS, Robert ae 
Psychology Department 
Brooklyn College 
Brooklyn 10, N. Y. A 1954 


HARRIS, Robert E.( Ph.D.) 
The Langley Porter Clinic 
University of California 
Medical Center 
San Francisco 22, Calif. A 1948 


HARRIS, William W. 
210 E. 181st Street 
Bronx, N. Y. A 1949 

*HARROWER, Molly R.( Ph.D.) 
55 E. 86th Street 
New York 28, N. Y. F 1940 

HARTZLER, Ethel N. 
Superintendent’s Office 
Northumberland County 
Public Schools 
Court House Annex 
Sunbury, Pa. A 1951 

HAWKINS, Mrs. Hermione 
Garrison Forest Road 


Owings Mills, Md. A 1951 
HAYS, Berta 

233 So. Kenmore Ave., #102 

Los Angeles 4, Calif. A 1949 


HEATH, Douglas (Ph.D.) 

Haverford College 

Haverford, A 1956 
HEBERT, Bernard 

P.O. Box 614 

Digby, Nova Scotia, Can. 
HEISLER, Verda( Ph.D.) 

1541 Eighth Avenue 

San Diego, Calif. A 1951 
HELLERSBERG, Elisabeth F. 

641 Whitney Avenue (Ph.D.) 

New Haven, Conn. A 1949 
HEMMENDINGER, Larry 

1026 Park Avenue (Ph.D.) 

Bridgeport, Conn. A 1950 
HENRY, William E.( Ph.D.) 

5835 Kimbark Avenue A 1948 

Chicago, Il. F 1956 
HERNESS, Mrs. Christina 

Amherst H. Wilder Child 

Guidance Clinic 

670 Marshall Avenue 

St. Paul 4, Minn. A 1952 

*HERTZ, Marguerite R.( Ph.D.) 
2835 Drummond Road 
Shaker Heights, Ohio F 1940 
*HERTZMAN, Max(Ph.D.) 
Department of se aa 


A 1955 


College of City of N. A 1940 

New York, N. Y F 1946 
HIGBEE, Dale S.( Ph.D.) 

VA Hospital 

Salisbury, N. C. A 1955 


HIGGINSON, Gordon K. ( Ph.D.) 
6040 N. Montana 
Portland, Ore. A 1954 
*HILDEN, Arnold H.(Ph.D. e 
628 Clark Avenue 
Webster Groves 19, Mo. t 1048 
HILKEVITCH, Rhea R.(Ph.D.) 
5715 Kenwood 
Chicago 37, Ill. A 1954 
HILLSON, Joseph (Ph.D.) 
Norfolk State Hospital 
Norfolk, Neb. A 1956 


HIMELSTEIN, Philip, (Ph.D.) 
114 Tansyl Drive 


San Antonio, Texas A 1956 
*HIRNING, L. C.(M.D.) 

R.F.D. #1 

Katonah, N.Y. F 1940 


HIRSCH, Mrs. Janet F. 

67-49-C 192nd Street 

Fresh Meadows 65, N.Y. A 1948 
HOCH, Erasmus L.( Ph.D.) 


125-16 Rosebud Drive 
Rockville, Md. A 1954 
HOCKER, Mrs. Margaret W. 
220 Reily Street 
Harrisburg, Pa. A 1951 
HOLMES, Frances B.( Ph.D.) 


R.D. 2, Harwinton 
Torrington, Conn. A 1950 


Directory 


HOLODNAK, Helen Barbara 
31-38—36th —s 
Astoria 3, L.1.,N.Y¥. A 1949 
(Ph.D.) 


HOLT, — M. 
3816 Bledsoe 
Los Angeles 66, Calif. A 1956 
—_ uy Robt. R.( Ph.D.) 
Y.U. Research wll for 
Me ntal Health 
21 Washington Place A 1948 
New York 3, N. Y. F 1951 


HOLZBE ‘- Jules D.( Ph.D. ‘ 
1949 


Box 35 
=F ell Conn. F 1954 
HORLICK, Reuben S.( Ph.D.) 


3004 N. Stuart Street 


Arlington 7, Va. A 1951 
HOUCK, Dorothy 

220 E. 12th Street 

New York, N. Y. A 1952 


HOUSMAN, Harold S.( Ph.D.) 
2550 Ivanhoe Drive 
Pontiac, Mich. A 1954 
HOWARD, J. W.( Ph.D.) 
Route 2 
Rigaud, P.Q., Canada 
HOWARD, Stephen J. 
3601 Marcia Drive St. Aff. 1954 
Los Angeles 26, Calif. 
HOWLAND, Allan O. 
Administration Building 
State Hospital 
Norristown, Pa. A 1951 


HUGHES, Robert M.(Ph.D.) 
Suite 10 
849 Peachtree St., N.E. A 1944 
Atlanta 8, Ga. F 1954 
HUTT, Max ~~ 
Department of Psychology 
University of Michigan A 1947 
Ann Arbor, Mich. F 1952 
IMRE, Paul 
Spring Grove State Hospital 


A 1954 


Catonsville 28, Md. A 1954 
IN MAN, John M. 

1310 La Loma Avenue 

Berkeley 8, Calif. A 1945 
IVERSON, Norman E. (Ph.D.) 

Suite 213 

2021 North Central Avenue 

Phoenix, Arizona 1956 
IVES, Margaret( Ph.D.) 

St. Elizabeths Hospital A 1953 

Washington 20, D.C. F 1955 


JACOBS, Martin E.( Ph.D.) 
27 Radial Lane 


Levittown, N.Y. A 1955 
* JACOBY, Julia 

R.D. 3 

Lincoln, Nebr. A 1940 


JAHODA, Hedwig (Ph.D.) 
500 W. 235th Street 
New York 63, N. Y. A 1952 
JEFFREYS, Alvis W., Jr.( Ph.D.) 
Western State Hospital 


Staunton, Va. A 1952 
JEFFRIES, Mrs. Helen 

14 East Sixth Street 

Media, Pa. A 1956 


JENSEN, Arthur R. (Ph.D.) 
Maudsley Hospital 
Denmark Hill 


London, England A 1956 
JOEL, Walther( Ph.D.) 

9629 Brighton Way A 1946 

Beverly Hills, Calif. F 1950 
JOHNSON, Elizabeth Z. 

VA Hospital (Ed.D.) 

Lexington, Ky. F 1956 


JOHNSON, Richard B. 
Bureau of Child Guidance 
362 Schermerhorn Street 
Brooklyn 17, N.Y. A 1953 
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1956 
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JOHNSON, Theresa 
229 S. Maple Drive 


Beverly Hills, Calif. A 1949 
JOSEPH, Alice(M.D.) 

Garrison-on-Hudson 

New York A 1944 


JOSEY, William E. 

11905 Heritage Lane 

Houston, Texas A 1949 
*JUNKEN, Elizabeth M.(Ph.D.) 

468 Lydecker Street 

Englewood, N. J. A 1940 
KABACK, Goldie R.( Ph.D.) 

375 Riverside Drive 

New York 25, N.Y. 
KADINSKY, D. 

8 P. Smolenski Street 

Tel Aviv, Israel A 1946 
KADIS, Mrs. Asya L. 

1060 Park Avenue 

New York 28, N. Y. 
KAHN, David F.(Ph.D.) 

Lexington School for Deaf 

904 Lexington Avenue 

New York 21, N. Y. A 1953 
KAHN, Marvin W. (Ph.D.) 

University of Colorado 

Medical School 

4200 E. 9th Avenue 

Denver, Colo. A 1956 
KAHN, Maj. Theodore C.(Ph.D.) 

2750 USAF Hospital 

Wright-Patterson A 1953 

AF Base, Ohio F 1954 
KALANT, Mrs. Lee 

4941 Co. onet Street 

Montreal 26, Canada A 1954 
KALINKOWITZ, Bernard N. 


A 1950 


A 1944 


Graduate School of (Ph.D.) 
Arts and Science 

New York University 
Washington Square 

New York, N. Y. A 1954 


KALIS, Betty Lee (Ph.D.) 

Langley Porter Clinic 

San Francisco 22, Cal. A 1956 
KAPIT, Milton E. 

1 W. 85th Street 

New York 21, N.Y 
KAPLAN, Henry K. 

Mendota State Hospital 

Madison, Wis. A 1956 
KAPLAN ,Herbert 

Patricia Avenue 

Fishkill, N. Y. 
KAPLAN, Norman( Ph.D.) 

2117 “‘E” Street, N.W. 

Washington 7, D.C. 
KASS, Walter( Ph.D.) 

Department of Psychiatry 

Albert Einstein College 

of Medicine 

New York 61, N.Y. 
KATES, Solis L.( Ph.D.) 

University of Massachusctts 

Amherst, Mass. A 1949 
KATZ, Mrs. Florine 

67 East 82nd Street 

New York 28, N.Y 
KATZ, Mrs. Harriet 

142 West Stella Lane 

Phoenix, Arizona A 1950 
KAUFMANN, Elizabeth M. 

414 W. 12lst Street 

New York 27, N. Y. A 1950 
KAVKEWITZ, Henry ( Ph.D.) 

1060 Union Street 

Brooklyn 25, N. Y A 1955 
*KELLEY, sone M. 1.(M. D.) 


44 Highgate 
Berkeley 7, Calif. F 1940 


A 1950 


A 1949 


A 1949 


F 1955 


A 1953 


KELLMAN, Samuel 
17606 Prairie 


Detroit 21, Mich. A 1949 
KELSEY, Howard Phelps 
1252 Fourth Street 
Sarasota, Fla. A 1944 
*KEMPLE, Camilla 
20 W. 86th Strect A 1940 
New York 24, N.Y. F 1946 


KENDIG, ae * V. _ D. ) 
Ashton, Md. 1946 
KESSLER, Mabel Sas 
Montgomery County 
Public Schools 
Court House 
Norristown, Pa. 
KEW, Clifton E. 
2 Gramercy Park So. 
New York 3, N.Y. 
KIDORF, Irwin W. 
7 Preston Court 
Lexington, Ky. St. Aff. 1955 
KING, Francis W.( Ph.D.) 
31 York Terrace 
Brookline 46, Mass. 
KINGSLEY, Dr. Leonard 
Walter Reed Army Hospital 
Wash. 12, D.C. St. Aff. 1954 
KIRK, Virginia( Ph.D.) 
Vanderbilt University 
School of Medicine 


A 1952 


A 1949 


A 1952 


Nashville 5, Tenn. A 1944 
KITAY, Philip M.( Ph.D.) 
8707—35th Avenue A 1955 


Jackson Heights 72, N. Y. 
KLASS, Walter K.( Ph.D.) 

North Central College 

146 N. Sleight Street 

Naperville, Ill. A 1946 
KLATSKIN, Ethelyn H.(Ph.D.) 

Yale University 

Child Study Center 


333 Cedar Street A 1946 
New Haven 11,Conn.  F 1955 
KLEIN, Abraham 
453 W. 21st Street 
New York 11, N. Y. A 1955 
*KLEIN, Eva L.(M.D.) 
1148 Fifth Avenue 
New York 28, N. Y. A 1940 


KLEIN, George S. (Ph.D.) 
Research Center for 
Mental Health 
21 Washington Place 
New York 3, N.Y. F 1956 
KLEINBERG, Mrs. Rosalyn K. 
6606 N. 11th St. 


Philadelphia 26, Pa. A 1950 
*KLOPFER, Bruno( Ph.D.) 

Box 2971 

Carmel, Calif. F 1940 


KLOPFER, Walter G.( Ph.D.) 
Norfolk State Hospital A 1946 
Norfolk, Nebr. F 1951 

KNAPP, Pearl G. (Ph.D.) 

8770 W. Whitworth Drive 
Los Angeles 35, Calif. F 1956 

KORDA, Mrs. Geraldine J. 

re S. Parkwood Avenue 
Pasadena 10, Calif. A 1949 

KORNER, Anneliese F.( Ph.D. ), 
2255 Post Street A 
San Francisco 15, Calif. F 1958 

mee key eats D.) 
147-10—84t 
Jamaica oI N 7" A 1951 

KOTKOV, Benjamin( Ph.D.) 

4 Country Hill 
West Brattleboro, Vt. A 1949 


*KRAFFT, Mrs. Margaret R. 
172 E. 91st Street 
New York 28, N. Y. A 1940 
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KRAL, V. Adalbert(M.D.) 
4145 Blueridge Crescent 
Montreal, Que., Can. A 1953 


KRASNER, Leonard (Ph.D.) 


VA Hospital 

Palo Alto, Calif. A 1952 
KRECZKOWSKI, Joseph 

729 Carson Street 

Pittsburgh 3, Pa. A 1944 


KROUT, Maurice H.( Ph.D.) 

1938 Cleveland 

Evanston, Ill. A 1950 
KRUGMAN, Dorothy C.(Ph.D.) 

425 Riverside Drive 

New York 25, N. Y. A 1944 
KRUGMAN, Herbert E.( Ph.D.) 

425 Riverside Drive 

New York 25, N. Y. A 1943 
KRUGMAN, Judith I.(Ph.D.) 

100 Remsen Street 

Brooklyn 1, N. Y¥. A 1941 

*KRUGMAN, Morris( Ph.D.) 

Board of Education 

110 Livingston Street 

Brooklyn 1, N.Y. F 1940 
KUSHNER, Malcolm (Ph.D.) 

118 Montgomery Avenue 

Bala Cynwyd, Pa. A 1956 
KUTASH, Samuel B.( Ph.D. ie 


3 Park Road 950 
Maplewood, N. J. r 1981 
LAKIN, Harriet A. 


1959 S. Crescent Heights 

Los Angeles 34, Calif A 1950 
LAMPL, Henry M. 

94 Fairmont Avenue 

Kingston, N. Y. 
LANDISBERG, Selma 

204 W. 88th Street 

New York 24, N. Y. 
LASKOWITZ, David 

1299 Grand 7 P 

New York 52 A 1953 
LAWRENCE, “ees $.( Ph.D.) 

240 S. La Cienega Blvd. " 

Beverly Hills, Calif. A 1955 
LAWRENCE, James F.( Ph.D.) 

Vet. Adm. Hospital > 1949 

Brockton, Mass. 1954 
LAWRENSON, Thomas . 

13-D Yale Street . 

Nutley, N. J. A 1955 
LEBEAUX, Mrs. Thelma W. 

106 Newton Avenue N. 

Worcester 9, Mass. A 1944 
LEBOWITZ, Mrs. Anne 

13746 Magnolia Boulevard 

Van Nuys, Calif. St. Aff. 1956 
LEDER, Ruth 

$01 E. 2ist Street 

New York 10, N. Y. A 1950 
LEDWITH, Nettie H.(Ph.D.) 

Pittsburgh Child Guid. Center 

201 DeSoto Street A 1948 


A 1955 


A 1950 


Pittsburgh 13, Pa. F 1952 
LEE, Dorothy B. 
33-33 82nd Street A 1950 


Jackson Heights 72, N. Y 
LEHMANN, Heinz E.(M.D.) 

Verdun Protestant Hospital 

Box 6034 A 1943 

Montreal, Que., Can. F 1951 
}.EHRER, Ruth( Ph.D.) 

Woodside Receiving Hospital 

800 E. Indianola Ave. A 1944 

Youngstown 8, Ohio F 1954 
LEIDEN, Irving (Ph.D.) 

739 Montrose 

Chicago 13, Ill. A 1956 
LEONARD, A. T. 

703 Madison Avenue, S.E. 

Grand Rapids, Mich. A 1954 
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LEOPOLD, Julius 
104-29 117th St. St. Aff. 1953 
Richmond Hill 19, N.Y. 
LEVENSTEIN, Mrs. Phyllis 
67-33 Kissena Boulevard 


Flushing, L.1.,N.Y. A 1948 
LEVEY, Archie 

Ste. 45, Community 

Apartments, Saskatoon, 

Saskatchewan, Can. A 1956 
LEVI, Joseph( Ph.D.) 

50 W. 72nd Street A 1947 

New York 23, N. Y F 1954 


LEVINE, Abraham ( Ph.D.) 
2354 Paulding Avenue 
Bronx 69, N.Y. 

LEVINE, Mrs. Phyllis R. 
3781 Bendemeer Road 
Cleveland Heights 18, 
Ohio A 1953 

LEVINGER, Leah 
340 East 5th Street 
New York 3, N.Y. A 1952 

LEVINSON, Boris M.( Ph.D.) 
39-25 47th Street A 1952 
Sunnyside, L. I. C. 4, 

N.Y. F 1956 


LEVIT, Herbert I. (Ph.D.) 
Dixmont State Hospital 
Glenfield, Pa. A 1954 

LEVY, Ruth Jacobs( Ph.D.) 

14430 Union Avenue 
Cambrian Park A 1948 
San Jose, Calif. F 1951 

LEVY, Sidney J. (Ph.D.) 

7417 S. Oglesby Avenue 
Chicago 49, Ill. A 1956 

LEWIS, Robert T.( Ph.D.) 
1948 Lupine Avenue 
Monterey Park, Calif. 

LIBRESCO, Emile 
R.D. 1, Box 14 
Pound Ridge, N. Y. 

LIEBEN, Mrs. Beatrice 
285 Fountain Road 
Englewood, N. J. 

LIT, Jack 
1606 Nedro Avenue 
Philadelphia 41, Pa. 

LITTLE, Jack F.( Ph.D.) 
8073 Earl Street 
Oakland 5, Calif. A 1949 

LOCKWOOD, Wallace V.(Ph.D.) 
2548 Fifth Avenue 
San Diego 3, Calif. A 1949 

LOEHRKE, Leah M.( Ph.D.) 
Veterans Administration 
12227 Clifton Blvd. 


A 1952 


A 1953 


A 1952 


A 1953 


A 1956 


Lakewood, Ohio A 1954 
LOLIS, Kathleen 

275 Clinton Avenue 

Brooklyn 5, N. Y. A 1949 


LONGLEY, James L. 
Industrial Psychology Division 
The Detroit Edison Company 
2000 Second Avenue 
Detroit 26, Mich. A 1953 


LONSTEIN, Murray ( Ph.D.) 
Veterans Administration Hosp. 
Leech Farm Road 
Pittsburgh 6, Pa. A 1953 


*LOPES, Jose Leme(M.D.) 
Rua Martins Ferreira 75 
Rio de Janeiro, Brazil 


LOW, Howard 
Department of Psychology 
Penn State University 
State College, Pa. A 1954 


LUCAS, Winafred B.( Ph.D.) 


7139 Hollywood Blvd. 
Los Angeles 46, Calif. A 1951 


F 1940 


LUNDIN, William ( Ph.D.) 
Chicago State Hospital 
6500 Irving Park Road 


Chicago 34, Ill. A 1954 
MacBRIDE, John L. 

12340 Tuller 

Detroit 4, Mich. A 1955 


MacDONALD, D. Stewart (Ph.D.) 
Knox Reeves Advertising, Inc. 
600 First National 
Soo Line Bldg. 


Minneapolis 2, Minn. A 1950 
MACHOVER, Mrs. Karen 

200 Fenimore Street A 1947 

Brooklyn 25, N. Y. F 1948 


MACHOVER, Solomon( Ph.D.) 
200 Fenimore Street A 1947 
Brooklyn 25, N. Y. F 1948 

MAGNETTE, Jules (Ph.D.) 
Nevada State Hospital 
Reno, Nevada A 1956 

MAHRER, Alvin R.( Ph.D.) 

Ist Lt., MSC, USA 

Box 336, OMS 

Fitzsimons Army Hospital 
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